com.bigdata.service

Class StressTestConcurrent

java.lang.Object

junit.framework.Assert

junit.framework.TestCase

junit.framework.TestCase2

com.bigdata.btree.AbstractBTreeTestCase

com.bigdata.service.AbstractEmbeddedFederationTestCase

com.bigdata.service.StressTestConcurrent

All Implemented Interfaces:

com.bigdata.testutil.ExperimentDriver.IComparisonTest, junit.framework.Test

public class StressTestConcurrent
extends AbstractEmbeddedFederationTestCase
implements com.bigdata.testutil.ExperimentDriver.IComparisonTest

Test suite for concurrent operations on a DataService. A federation consisting of a MetadataService and a single DataService is started. A client is created, connects to the federation, and registers an index the federation. A pool of threads is created for that client and populated with a number of operations. The threads then write and read concurrently using unisolated operations on the data services. This test can be used to observe the throughput and queue depth of arising from a variety of data service and client configurations.

Version:

$Id$

Author:

Bryan Thompson

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	StressTestConcurrent.GenerateExperiment Experiment generation utility class.
static class	StressTestConcurrent.Task Run an unisolated operation.
static interface	StressTestConcurrent.TestOptions Additional properties understood by this test.

Nested classes/interfaces inherited from class junit.framework.TestCase2

TestCase2.MyProperties, TestCase2.RandomType

Field Summary

Fields inherited from class com.bigdata.service.AbstractEmbeddedFederationTestCase

client, dataService0, dataService1, fed, metadataService

Fields inherited from class com.bigdata.btree.AbstractBTreeTestCase

keyBuilder, log, r

Fields inherited from class junit.framework.TestCase2

_randomType

Constructor Summary

Constructors

Constructor and Description
StressTestConcurrent()
StressTestConcurrent(String arg0)

Method Summary

Methods

Modifier and Type	Method and Description
com.bigdata.testutil.ExperimentDriver.Result	doComparisonTest(Properties properties) Setup and run a test.
com.bigdata.testutil.ExperimentDriver.Result	doConcurrentClientTest(IBigdataClient<?> client, int nclients, long timeout, int ntrials, int keyLen, int nops, double insertRate, int nindices, boolean testCorrectness) A stress test with a pool of concurrent clients.
Properties	getProperties() Reads in the configuration properties for the test from a variety of resources and returns a properties hierarchy.
static void	main(String[] args) Runs a single instance of the test as configured in the code.
void	setUpComparisonTest(Properties properties)
void	tearDownComparisonTest()
void	test_stressTest2() Test of N concurrent operations.

Methods inherited from class com.bigdata.service.AbstractEmbeddedFederationTestCase

assertEquals, assertEquals, assertEquals, assertIndexRegistered, awaitAsynchronousOverflow, getPartitionCount, setUp, tearDown

Methods inherited from class com.bigdata.btree.AbstractBTreeTestCase

assertChildKeys, assertEntryCounts, assertKeys, assertKeys, assertKeys, assertSameAbstractNodeData, assertSameBTree, assertSameEntryIterator, assertSameEntryIterator, assertSameIterator, assertSameIterator, assertSameLeaf, assertSameLeafData, assertSameNode, assertSameNodeData, assertSameNodeOrLeaf, assertSameRaba, assertValues, assertValues, doEntryIteratorTest, doInsertKeySequenceTest, doInsertLookupRemoveStressTest, doInsertRandomKeySequenceTest, doInsertRandomKeySequenceTest, doInsertRandomSparseKeySequenceTest, doKnownKeySequenceTest, doRandomIndexOfTest, doRandomKeyInsertTest, doRandomLookupTest, doRemoveStructureStressTest, doSplitTest, doSplitWithDecreasingKeySequence, doSplitWithIncreasingKeySequence, doSplitWithRandomDenseKeySequence, getBTree, getBTree, getKeysAndValues, getRandomKeys, getRandomKeyValues, i2k, nextLong, useRawRecords

Methods inherited from class junit.framework.TestCase2

assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEqualsWithinUlps, assertSameArray, assertSameArray, assertSameBigDecimal, assertSameBigDecimal, assertSameBigInteger, assertSameBigInteger, assertSameIterator, assertSameIterator, assertSameIteratorAnyOrder, assertSameIteratorAnyOrder, assertSameValue, assertSameValue, assertZeroUlps, assertZeroUlps, fail, getInnerCause, getNormalInt, getProjectBuildPath, getRandomObject, getRandomObject, getRandomOrder, getRandomString, getTestInputStream, getTestResource, getTestResource, getUlps, getUlps, isDEBUG, isDEBUG, isINFO, isINFO, isInnerCause, logProperties

Methods inherited from class junit.framework.TestCase

assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertFalse, assertFalse, assertNotNull, assertNotNull, assertNotSame, assertNotSame, assertNull, assertNull, assertSame, assertSame, assertTrue, assertTrue, countTestCases, createResult, fail, fail, failNotEquals, failNotSame, failSame, format, getName, run, run, runBare, runTest, setName, toString

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

StressTestConcurrent

public StressTestConcurrent()

StressTestConcurrent

public StressTestConcurrent(String arg0)

Parameters:

arg0 -

Method Detail

getProperties

public Properties getProperties()

Description copied from class: TestCase2

Reads in the configuration properties for the test from a variety of resources and returns a properties hierarchy. If a property name is not bound at the top-level of the returned Properties object, then the lower levels of the hierarchy are recursively searched.

The hierarchy is constructed from the following properties files in the following order. The first property file in this list corresponds to the top of the property hierarchy. The last property file in this list corresponds to the bottom of the property hierarchy. The property resources are:

1. The System properties specified using the -D argument on the command line.
2. ${user.home}/build.properties. ${user.home} is the value of the Java system environment variable named "user.home" and corresponds to the user home directory. A warning is logged if this properties file does not exist. Note: The JUnit UI can wind up with a different value for this property than when you execute tests without the UI. It is an error if the properties file exists but can not be read.
3. {class}.properties, where {class} is the class name reported by Java reflection, is loaded iff it is found.
4. {class} is repeatedly truncated by dropping the last package name component to generate a package name. If a properties file named "test.properties" exists in that package then those properties are loaded.

Overrides:

getProperties in class AbstractEmbeddedFederationTestCase

Returns:

A Properties object that supplies bindings for property names according to the described hierarchy among property resources. The returned Properties is NOT cached. TODO This does not handle the recursive truncation of the class name to search for "test.properties" yet.

setUpComparisonTest

public void setUpComparisonTest(Properties properties)
                         throws Exception

Specified by:

setUpComparisonTest in interface com.bigdata.testutil.ExperimentDriver.IComparisonTest

Throws:

Exception

tearDownComparisonTest

public void tearDownComparisonTest()
                            throws Exception

Specified by:

tearDownComparisonTest in interface com.bigdata.testutil.ExperimentDriver.IComparisonTest

Throws:

Exception

test_stressTest2

public void test_stressTest2()
                      throws Exception

Test of N concurrent operations.

Throws:

Exception

doConcurrentClientTest

public com.bigdata.testutil.ExperimentDriver.Result doConcurrentClientTest(IBigdataClient<?> client,
                                                                  int nclients,
                                                                  long timeout,
                                                                  int ntrials,
                                                                  int keyLen,
                                                                  int nops,
                                                                  double insertRate,
                                                                  int nindices,
                                                                  boolean testCorrectness)
                                                                    throws InterruptedException,
                                                                           IOException

A stress test with a pool of concurrent clients.

Parameters:

client - The client.

timeout - The #of seconds before the test will terminate (ignored if testCorrectness := true since tasks MUST run to completion in order for comparisons against ground truth to be valid).

nclients - The #of concurrent clients.

ntrials - The #of batch (remote) operations to execute.

keyLen - The length of the random unsigned byte[] keys used in the operations. The longer the keys the less likely it is that there will be a write-write conflict (that concurrent txs will write on the same key).

nops - The #of rows in each operation.

insertRate - The rate of insert operations (inserting nops tuples) in [0.0:1.0]. The balance of the operations will remove nops tuples.

nindices - The #of different indices to which the operation will be applied. The tasks will be generated modulo nindices. When nindices is greater than one, there is increased likelihood of tasks running concurrently before the first split. Regardless of the value of nindices, after a scale-out index has been split the likelihood of concurrent writers goes up significantly.

testCorrectness - When true, ground truth will be maintained and verified against the post-condition of the index(s) under test. This option may be used to verify index partition split/join/move semantics and the correctness of ClientIndexView views. All operations on a ground truth index are serialized (all operations may be serialized if the ground truth indices are all backed by the same store) so this option can not be used when you are doing performance testing.

Throws:

InterruptedException

IOException

main

public static void main(String[] args)
                 throws Exception

Runs a single instance of the test as configured in the code.

Throws:

Exception

See Also:

ExperimentDriver, which parameterizes the use of this stress test. That information should be used to limit the #of transactions allowed to start at one time on the server and should guide a search for thinning down resource consumption, e.g., memory usage by btrees, the node serializer, etc., GenerateExperiment, which may be used to generate a set of conditions to be run by the {@link ExperimentDriver}.

doComparisonTest

public com.bigdata.testutil.ExperimentDriver.Result doComparisonTest(Properties properties)
                                                              throws Exception

Setup and run a test.

Specified by:

doComparisonTest in interface com.bigdata.testutil.ExperimentDriver.IComparisonTest

Parameters:

properties - There are no "optional" properties - you must make sure that each property has a defined value.

Throws:

Exception