com.bigdata.bop.engine

Class TestQueryEngine

java.lang.Object

junit.framework.Assert

junit.framework.TestCase

junit.framework.TestCase2

com.bigdata.bop.engine.AbstractQueryEngineTestCase

com.bigdata.bop.engine.TestQueryEngine

All Implemented Interfaces:

junit.framework.Test

public class TestQueryEngine
extends AbstractQueryEngineTestCase

Test suite for the QueryEngine against a local database instance.

Note: The BOps are unit tested separately. This test suite is focused on interactions when BOps are chained together in a query, such as a sequence of pipeline joins, a slice applied to a query, etc.

 -Dlog4j.configuration=bigdata/src/resources/logging/log4j.properties
 

Author:

Bryan Thompson

See Also:

TestFederatedQueryEngine

Nested Class Summary

Nested classes/interfaces inherited from class junit.framework.TestCase2

TestCase2.MyProperties, TestCase2.RandomType

Field Summary

Fields inherited from class com.bigdata.bop.engine.AbstractQueryEngineTestCase

log

Fields inherited from class junit.framework.TestCase2

_randomType

Constructor Summary

Constructors

Constructor and Description
TestQueryEngine()
TestQueryEngine(String name)

Method Summary

Methods

Modifier and Type	Method and Description
protected int	doStressTest(long timeout, int ntrials, int poolSize)
Properties	getProperties() Reads in the configuration properties for the test from a variety of resources and returns a properties hierarchy.
void	setUp()
void	tearDown()
void	test_query_closeIterator() Test verifies the ability close the iterator draining a result set before the query has finished executing and also verify that the query is correctly terminated.
void	test_query_join_withConstraint() A join with an IConstraint.
void	test_query_join1_multipleChunksIn() Test the ability run a simple join when multiple binding sets are submitted as the initial input.
void	test_query_join1_without_StartOp() Test the ability run a simple join without a StartOp.
void	test_query_join1() Test the ability run a simple join.
void	test_query_join2_conditionalRoutingFalse() Unit test for ConditionalRoutingOp.
void	test_query_join2_conditionalRoutingTrue() Unit test for ConditionalRoutingOp.
void	test_query_join2_optionals() Unit test for optional join.
void	test_query_join2() Test the ability run a query requiring two joins.
void	test_query_slice_noLimit() Unit test runs chunks into a slice without a limit.
void	test_query_slice() Run a join with a slice.
void	test_query_startRun() Test the ability to run a query which does nothing and produces no solutions.
void	test_queryJoin2_concurrentStressTest() Concurrent stress test of #test_queryJoin2() which runs a fixed number of trials on a pool of N=10 threads.
void	test_queryJoin2_stressTest() A stress test of test_query_join2() which runs a fixed number of presentations in a single thread.
void	test_slice_threadSafe()
void	test_startStop() Starts and stops the QueryEngine, but does not validate the semantics of shutdown() versus shutdownNow() since we need to be evaluating query mixes in order to verify the semantics of those operations.
void	testLatchExecutorProgression() Test the LatchExecutor to verify reliable progression with multiple threads contending to add tasks.

Methods inherited from class com.bigdata.bop.engine.AbstractQueryEngineTestCase

assertSameSolutions, assertSameSolutions, assertSameSolutions, assertSameSolutionsAnyOrder, assertSameSolutionsAnyOrder, assertSameSolutionsAnyOrder, assertSameSolutionsAnyOrder, assertSameSolutionsAnyOrder, assertSameSolutionsAnyOrder, compareGraphs, compareTupleQueryResults, diff

Methods inherited from class junit.framework.TestCase2

assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEqualsWithinUlps, assertSameArray, assertSameArray, assertSameBigDecimal, assertSameBigDecimal, assertSameBigInteger, assertSameBigInteger, assertSameIterator, assertSameIterator, assertSameIteratorAnyOrder, assertSameIteratorAnyOrder, assertSameValue, assertSameValue, assertZeroUlps, assertZeroUlps, fail, getInnerCause, getNormalInt, getProjectBuildPath, getRandomObject, getRandomObject, getRandomOrder, getRandomString, getTestInputStream, getTestResource, getTestResource, getUlps, getUlps, isDEBUG, isDEBUG, isINFO, isINFO, isInnerCause, logProperties

Methods inherited from class junit.framework.TestCase

assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertFalse, assertFalse, assertNotNull, assertNotNull, assertNotSame, assertNotSame, assertNull, assertNull, assertSame, assertSame, assertTrue, assertTrue, countTestCases, createResult, fail, fail, failNotEquals, failNotSame, failSame, format, getName, run, run, runBare, runTest, setName, toString

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

TestQueryEngine

public TestQueryEngine()

TestQueryEngine

public TestQueryEngine(String name)

Parameters:

name -

Method Detail

getProperties

public Properties getProperties()

Description copied from class: TestCase2

Reads in the configuration properties for the test from a variety of resources and returns a properties hierarchy. If a property name is not bound at the top-level of the returned Properties object, then the lower levels of the hierarchy are recursively searched.

The hierarchy is constructed from the following properties files in the following order. The first property file in this list corresponds to the top of the property hierarchy. The last property file in this list corresponds to the bottom of the property hierarchy. The property resources are:

1. The System properties specified using the -D argument on the command line.
2. ${user.home}/build.properties. ${user.home} is the value of the Java system environment variable named "user.home" and corresponds to the user home directory. A warning is logged if this properties file does not exist. Note: The JUnit UI can wind up with a different value for this property than when you execute tests without the UI. It is an error if the properties file exists but can not be read.
3. {class}.properties, where {class} is the class name reported by Java reflection, is loaded iff it is found.
4. {class} is repeatedly truncated by dropping the last package name component to generate a package name. If a properties file named "test.properties" exists in that package then those properties are loaded.

Overrides:

getProperties in class TestCase2

Returns:

A Properties object that supplies bindings for property names according to the described hierarchy among property resources. The returned Properties is NOT cached. TODO This does not handle the recursive truncation of the class name to search for "test.properties" yet.

setUp

public void setUp()
           throws Exception

Overrides:

setUp in class junit.framework.TestCase

Throws:

Exception

tearDown

public void tearDown()
              throws Exception

Overrides:

tearDown in class junit.framework.TestCase

Throws:

Exception

test_startStop

public void test_startStop()
                    throws Exception

Starts and stops the QueryEngine, but does not validate the semantics of shutdown() versus shutdownNow() since we need to be evaluating query mixes in order to verify the semantics of those operations.

Throws:

Exception

test_query_startRun

public void test_query_startRun()
                         throws Exception

Test the ability to run a query which does nothing and produces no solutions.

Throws:

Exception

test_slice_threadSafe

public void test_slice_threadSafe()
                           throws Exception

Throws:

Exception

test_query_join1_without_StartOp

public void test_query_join1_without_StartOp()
                                      throws Exception

Test the ability run a simple join without a StartOp. An empty binding set[] is fed into the join. The join probes the index once for "Mary" and binds "Paul" when it does so. There there is one solution, which is "value=Paul".

Throws:

Exception

test_query_join1

public void test_query_join1()
                      throws Exception

Test the ability run a simple join. There are three operators. One feeds an empty binding set[] into the join, another is the predicate for the access path on which the join will read (it probes the index once for "Mary" and binds "Paul" when it does so), and the third is the join itself (there is one solution, which is "value=Paul").

Throws:

Exception

test_query_join1_multipleChunksIn

public void test_query_join1_multipleChunksIn()
                                       throws Exception

Test the ability run a simple join when multiple binding sets are submitted as the initial input. The access path associated with the join does not have any constants but the join picks up bindings from the input binding sets and uses them to constrain the access path.

Throws:

Exception

test_query_closeIterator

public void test_query_closeIterator()
                              throws Exception

Test verifies the ability close the iterator draining a result set before the query has finished executing and also verify that the query is correctly terminated.

Note: This is difficult to test without having significant data scale since there is an implicit race between the consumer and the producer to close out the query evaluation, but the PipelineDelayOp can be used to impose sufficient latency on the pipeline that the test can close the query buffer iterator first.

Note: This must also be tested in scale-out to make sure that the data backing the solutions is not discarded before the caller can use those data.

This could be handled by: (a) materializing binding set objects out of a ByteBuffer rather than using a live decode of the data in that ByteBuffer; or by (b) using an special DirectBufferPoolAllocator.IAllocationContext which is scoped to the query results such that they are not released until the iterator draining the buffer is closed.

Throws:

Exception

test_query_slice_noLimit

public void test_query_slice_noLimit()
                              throws Exception

Unit test runs chunks into a slice without a limit. This verifies that the query terminates properly even though the slice is willing to accept more data.

When the IRunningQuery implementation supports it, the source data are presented in multiple chunks in order to verify the behavior of the SliceOp across multiple (and potentially concurrent) invocations of that operator.

Throws:

Exception

test_query_slice

public void test_query_slice()
                      throws Exception

Run a join with a slice. The slice is always evaluated on the query controller so adding it to the query plan touches a slightly different code path from adding another join (joins are evaluated shardwise, at least in scale-out).

Note: While the logic for visiting only the solutions selected by the slice can be tested against a mock object, the integration by which a slice halts a query when it is satisfied has to be tested against a QueryEngine.

This must also be tested in scale-out to make sure that the data backing the solutions is not discarded before the caller can use those data. [This could be handled by materializing binding set objects out of a ByteBuffer rather than using a live decode of the data in that ByteBuffer.]

Throws:

Exception

test_query_join_withConstraint

public void test_query_join_withConstraint()
                                    throws Exception

A join with an IConstraint.

Throws:

Exception

test_query_join2

public void test_query_join2()
                      throws Exception

Test the ability run a query requiring two joins.

Throws:

Exception

test_queryJoin2_stressTest

public void test_queryJoin2_stressTest()
                                throws Exception

A stress test of test_query_join2() which runs a fixed number of presentations in a single thread.

Throws:

Exception

test_queryJoin2_concurrentStressTest

public void test_queryJoin2_concurrentStressTest()
                                          throws Exception

Concurrent stress test of #test_queryJoin2() which runs a fixed number of trials on a pool of N=10 threads.

Throws:

Exception

doStressTest

protected int doStressTest(long timeout,
               int ntrials,
               int poolSize)
                    throws Exception

Parameters:

timeout -

ntrials -

poolSize -

Returns:

The #of successful trials.

Throws:

Exception

test_query_join2_optionals

public void test_query_join2_optionals()
                                throws Exception

Unit test for optional join. Two joins are used and target a SliceOp. The 2nd join is marked as optional. Intermediate results which do not succeed on the optional join are forwarded to the SliceOp which is the target specified by the PipelineOp.Annotations#ALT_SINK_REF.

Throws:

Exception

test_query_join2_conditionalRoutingTrue

public void test_query_join2_conditionalRoutingTrue()
                                             throws Exception

Unit test for ConditionalRoutingOp. This test case tests when the condition is true (the joins are not skipped) in which case the test (and results) are essentially identical to test_query_join2().

Throws:

Exception

test_query_join2_conditionalRoutingFalse

public void test_query_join2_conditionalRoutingFalse()
                                              throws Exception

Unit test for ConditionalRoutingOp. This test case tests when the condition is false (the joins are skipped).

Throws:

Exception

testLatchExecutorProgression

public void testLatchExecutorProgression()
                                  throws InterruptedException

Test the LatchExecutor to verify reliable progression with multiple threads contending to add tasks.

Throws:

InterruptedException