Collaboration diagram for com.mapd.bench.Benchmark:

Static Public Member Functions
static void	main (String[] args)

Package Functions
void	doWork (String[] args, int query)

String	executeQuery (String sql, int expected, int iterations, int queryNum)

Static Package Attributes
static final Logger	logger = LoggerFactory.getLogger(Benchmark.class)

static final String	JDBC_DRIVER = "ai.heavy.jdbc.HeavyAIDriver"

static final String	DB_URL = "jdbc:heavyai:localhost:6274:mapd"

static final String	USER = "admin"

static final String	PASS = "HyperInteractive"

Private Attributes
String	driver

String	url

String	iUser

String	iPasswd

String	headDescriptor

String	header2

String	lineDescriptor

Detailed Description

Definition at line 34 of file Benchmark.java.

Member Function Documentation

void com.mapd.bench.Benchmark.doWork	(	String[]	args,
		int	query
	)

inlinepackage

Definition at line 86 of file Benchmark.java.

References com.mapd.bench.Benchmark.DB_URL, com.mapd.bench.Benchmark.driver, com.mapd.bench.Benchmark.executeQuery(), com.mapd.bench.Benchmark.header2, com.mapd.bench.Benchmark.iPasswd, com.mapd.bench.Benchmark.iUser, com.mapd.bench.Benchmark.JDBC_DRIVER, com.mapd.bench.Benchmark.PASS, com.mapd.bench.Benchmark.url, and com.mapd.bench.Benchmark.USER.

                                         {
     // Grab parameters from args
     // parm0 number of iterations per query
     // parm1 file containing sql queries {contains quoted query, expected result
     // count]
     // parm2 optional JDBC Driver class name
     // parm3 optional DB URL
     // parm4 optionsl user
     // parm5 optional passwd
     int iterations = Integer.valueOf(args[0]);
     logger.debug("Iterations per query is " + iterations);
 
     String queryFile = args[1];
 
     // int expectedResults = Integer.valueOf(args[2]);
     driver = (args.length > 2) ? args[2] : JDBC_DRIVER;
     url = (args.length > 3) ? args[3] : DB_URL;
     iUser = (args.length > 4) ? args[4] : USER;
     iPasswd = (args.length > 5) ? args[5] : PASS;
 
     // register the driver
     try {
       // Register JDBC driver
       Class.forName(driver);
     } catch (ClassNotFoundException ex) {
       logger.error("Could not load class " + driver + " " + ex.getMessage());
       System.exit(1);
     }
 
     // read from query file and execute queries
     String sCurrentLine;
     List<String> resultArray = new ArrayList();
     BufferedReader br;
     try {
       br = new BufferedReader(new FileReader(queryFile));
       int qCount = 1;
 
       while ((sCurrentLine = br.readLine()) != null) {
         int expected = 0;
         String sqlQuery = null;
         // find the last comma and then grab the rest as sql
         for (int i = sCurrentLine.length(); i > 0; i--) {
           if (sCurrentLine.charAt(i - 1) == ',') {
             // found the comma
             expected = Integer.valueOf(sCurrentLine.substring(i).trim());
             sqlQuery = sCurrentLine.substring(0, i - 1).trim().substring(1);
             break;
           }
         }
         // remove final "
         sqlQuery = sqlQuery.substring(0, sqlQuery.length() - 1);
 
         System.out.println(String.format("Q%02d %s", qCount, sqlQuery));
 
         resultArray.add(executeQuery(sqlQuery, expected, iterations, qCount));
 
         qCount++;
       }
     } catch (FileNotFoundException ex) {
       logger.error("Could not find file " + queryFile + " " + ex.getMessage());
       System.exit(2);
     } catch (IOException ex) {
       logger.error("IO Exeception " + ex.getMessage());
       System.exit(3);
     }
 
     // All done dump out results
     System.out.println(header2);
     for (String s : resultArray) {
       System.out.println(s);
     }
   }

Here is the call graph for this function:

String com.mapd.bench.Benchmark.executeQuery	(	String	sql,
		int	expected,
		int	iterations,
		int	queryNum
	)

inlinepackage

Definition at line 159 of file Benchmark.java.

References report.conn, com.mapd.bench.Benchmark.driver, com.mapd.bench.Benchmark.iPasswd, com.mapd.bench.Benchmark.iUser, com.mapd.bench.Benchmark.JDBC_DRIVER, com.mapd.bench.Benchmark.lineDescriptor, and com.mapd.bench.Benchmark.url.

Referenced by com.mapd.bench.Benchmark.doWork().

                                                                               {
     Connection conn = null;
     Statement stmt = null;
 
     Long firstExecute = 0l;
     Long firstJdbc = 0l;
     Long firstIterate = 0l;
 
     DescriptiveStatistics statsExecute = new DescriptiveStatistics();
     DescriptiveStatistics statsJdbc = new DescriptiveStatistics();
     DescriptiveStatistics statsIterate = new DescriptiveStatistics();
     DescriptiveStatistics statsTotal = new DescriptiveStatistics();
 
     long totalTime = 0;
 
     try {
       // Open a connection
       logger.debug("Connecting to database url :" + url);
       conn = DriverManager.getConnection(url, iUser, iPasswd);
 
       long startTime = System.currentTimeMillis();
       for (int loop = 0; loop < iterations; loop++) {
         // Execute a query
         stmt = conn.createStatement();
 
         long timer = System.currentTimeMillis();
         ResultSet rs = stmt.executeQuery(sql);
 
         long executeTime = 0;
         long jdbcTime = 0;
 
         // gather internal execute time for HeavyAI as we are interested in that
         if (driver.equals(JDBC_DRIVER)) {
           executeTime = ((HeavyAIStatement) stmt).getQueryInternalExecuteTime();
           jdbcTime = (System.currentTimeMillis() - timer) - executeTime;
         } else {
           jdbcTime = (System.currentTimeMillis() - timer);
           executeTime = 0;
         }
         // this is fake to get our intenal execute time.
         logger.debug("Query Timeout/AKA internal Execution Time was "
                 + stmt.getQueryTimeout() + " ms Elapsed time in JVM space was "
                 + (System.currentTimeMillis() - timer) + "ms");
 
         timer = System.currentTimeMillis();
         // Extract data from result set
         int resultCount = 0;
         while (rs.next()) {
           Object obj = rs.getObject(1);
           if (obj != null && obj.equals(statsExecute)) {
             logger.info("Impossible");
           }
           resultCount++;
         }
         long iterateTime = (System.currentTimeMillis() - timer);
 
         if (resultCount != expected) {
           logger.error(
                   "Expect " + expected + " actual " + resultCount + " for query " + sql);
           // don't run anymore
           break;
         }
 
         if (loop == 0) {
           firstJdbc = jdbcTime;
           firstExecute = executeTime;
           firstIterate = iterateTime;
 
         } else {
           statsJdbc.addValue(jdbcTime);
           statsExecute.addValue(executeTime);
           statsIterate.addValue(iterateTime);
           statsTotal.addValue(jdbcTime + executeTime + iterateTime);
         }
 
         // Clean-up environment
         rs.close();
         stmt.close();
       }
       totalTime = System.currentTimeMillis() - startTime;
       conn.close();
     } catch (SQLException se) {
       // Handle errors for JDBC
       se.printStackTrace();
     } catch (Exception e) {
       // Handle errors for Class.forName
       e.printStackTrace();
     } finally {
       // finally block used to close resources
       try {
         if (stmt != null) {
           stmt.close();
         }
       } catch (SQLException se2) {
       } // nothing we can do
       try {
         if (conn != null) {
           conn.close();
         }
       } catch (SQLException se) {
         se.printStackTrace();
       } // end finally try
     } // end try
 
     return String.format(lineDescriptor,
             queryNum,
             statsTotal.getMean(),
             statsTotal.getMin(),
             statsTotal.getMax(),
             statsTotal.getPercentile(85),
             statsExecute.getMean(),
             statsExecute.getMin(),
             statsExecute.getMax(),
             statsExecute.getPercentile(85),
             statsExecute.getPercentile(25),
             statsExecute.getStandardDeviation(),
             statsJdbc.getMean(),
             statsJdbc.getMin(),
             statsJdbc.getMax(),
             statsJdbc.getPercentile(85),
             statsIterate.getMean(),
             statsIterate.getMin(),
             statsIterate.getMax(),
             statsIterate.getPercentile(85),
             firstExecute,
             firstJdbc,
             firstIterate,
             iterations,
             totalTime,
             (long) statsTotal.getSum() + firstExecute + firstJdbc + firstIterate);
   }

Here is the caller graph for this function:

static void com.mapd.bench.Benchmark.main ( String[] args )

inlinestatic

Definition at line 81 of file Benchmark.java.

References run_benchmark_import.args.

                                          {
     Benchmark bm = new Benchmark();
     bm.doWork(args, 1);
   }

Member Data Documentation

final String com.mapd.bench.Benchmark.DB_URL = "jdbc:heavyai:localhost:6274:mapd"

staticpackage

Definition at line 39 of file Benchmark.java.

Referenced by com.mapd.bench.Benchmark.doWork().

String com.mapd.bench.Benchmark.driver

private

Definition at line 45 of file Benchmark.java.

Referenced by com.mapd.bench.Benchmark.doWork(), and com.mapd.bench.Benchmark.executeQuery().

String com.mapd.bench.Benchmark.headDescriptor

private

Initial value:

=

"%3s, %8s,%8s,%8s,%8s,%8s,%8s,%8s,%8s,%8s,%8s,%8s,%8s,%8s,%8s,%8s,%8s,%8s,%8s,%8s,%8s,%8s,%8s,%8s,%8s"

Definition at line 50 of file Benchmark.java.

String com.mapd.bench.Benchmark.header2

private

Initial value:

= String.format(headDescriptor,
          "QRY",
          "T-Avg",
          "T-Min",
          "T-Max",
          "T-85%",
          "E-Avg",
          "E-Min",
          "E-Max",
          "E-85%",
          "E-25%",
          "E-StdD",
          "J-Avg",
          "J-Min",
          "J-Max",
          "J-85%",
          "I-Avg",
          "I-Min",
          "I-Max",
          "I-85%",
          "F-Exec",
          "F-jdbc",
          "F-iter",
          "ITER",
          "Total",
          "Account")