com.mapd.logrunner.LogRunner Class Reference

Collaboration diagram for com.mapd.logrunner.LogRunner:

Classes
class	myThread

Public Member Functions
	LogRunner ()

Static Public Member Functions
static void	main (String[] args) throws TException

Package Functions
void	doWork (String[] args) throws TTransportException, TException

Static Package Attributes
static final Logger	logger = LoggerFactory.getLogger(LogRunner.class)

Private Member Functions
OmniSci.Client	getClient (String hostname, int port) throws TTransportException
String	getSession (OmniSci.Client client) throws TTransportException, TOmniSciException, TException
void	closeSession (OmniSci.Client client, String session) throws TOmniSciException, TException
void	theRest (OmniSci.Client client, String session) throws TException

Private Attributes
HashMap< Integer, String >	sqlquery
HashMap< Integer, String >	originalSql
HashMap< Integer, String >	json
boolean	gpuMode = false
boolean	cpuMode = false

Detailed Description

Author

michael

Definition at line 62 of file LogRunner.java.

Constructor & Destructor Documentation

com.mapd.logrunner.LogRunner.LogRunner ( )

inline

Definition at line 82 of file LogRunner.java.

References com.mapd.logrunner.LogRunner.json, com.mapd.logrunner.LogRunner.originalSql, and com.mapd.logrunner.LogRunner.sqlquery.

Referenced by com.mapd.logrunner.LogRunner.main().

                     {
    sqlquery = new HashMap<Integer, String>();
    originalSql = new HashMap<Integer, String>();
    json = new HashMap<Integer, String>();
  }

Here is the caller graph for this function:

Member Function Documentation

void com.mapd.logrunner.LogRunner.closeSession ( OmniSci.Client  client, String  session  ) throws TOmniSciException, TException

inlineprivate

Definition at line 151 of file LogRunner.java.

                                               {
    // Now disconnect
    logger.info("Trying to disconnect session " + session);
    client.disconnect(session);
  }

void com.mapd.logrunner.LogRunner.doWork ( String[]  args ) throws TTransportException, TException

inlinepackage

Definition at line 88 of file LogRunner.java.

References run_benchmark_import.args, com.mapd.logrunner.LogRunner.getClient(), com.mapd.logrunner.LogRunner.getSession(), and Integer.

                                                                    {
    logger.info("In doWork here");

    int numberThreads = 3;
    //    Runnable[] worker = new Runnable[numberThreads];
    //
    //    for (int i = 0; i < numberThreads; i++){
    //
    OmniSci.Client client = getClient(args[0], Integer.valueOf(args[1]));
    String session = getSession(client);
    //      worker[i] = new myThread(client, session);
    //    }

    logger.info("got session");
    try {
      // ExecutorService executor = Executors.newFixedThreadPool(6);
      ExecutorService executor = new ThreadPoolExecutor(numberThreads,
              numberThreads,
              0L,
              TimeUnit.MILLISECONDS,
              new ArrayBlockingQueue<Runnable>(15),
              new ThreadPoolExecutor.CallerRunsPolicy());
      while (true) {
        // BufferedReader in = new BufferedReader(new FileReader("/data/logfiles/log1"));
        BufferedReader in = new BufferedReader(new FileReader(args[2]));
        String str;
        int current = 0;
        while ((str = in.readLine()) != null) {
          Runnable worker = new myThread(str, client, session);
          // executor.execute(worker);
          worker.run();
        }
        in.close();
        logger.info("############loop complete");
      }
      // executor.shutdown();
    } catch (IOException e) {
      logger.error("IOException " + e.getMessage());
    }
  }

Here is the call graph for this function:

OmniSci.Client com.mapd.logrunner.LogRunner.getClient ( String  hostname, int  port  ) throws TTransportException

inlineprivate

Definition at line 129 of file LogRunner.java.

Referenced by com.mapd.logrunner.LogRunner.doWork().

                                                                                         {
    TTransport transport = null;

    // transport = new TSocket("localhost", 6274);
    transport = new THttpClient("http://" + hostname + ":" + port);

    transport.open();

    // TProtocol protocol = new TBinaryProtocol(transport);
    TProtocol protocol = new TJSONProtocol(transport);
    // TProtocol protocol = new TProtocol(transport);

    return new OmniSci.Client(protocol);
  }

Here is the caller graph for this function:

String com.mapd.logrunner.LogRunner.getSession ( OmniSci.Client  client ) throws TTransportException, TOmniSciException, TException

inlineprivate

Definition at line 144 of file LogRunner.java.

Referenced by com.mapd.logrunner.LogRunner.doWork().

                                                                    {
    String session = client.connect("mapd", "HyperInteractive", "mapd");
    logger.info("Connected session is " + session);
    return session;
  }

Here is the caller graph for this function:

static void com.mapd.logrunner.LogRunner.main ( String[]  args ) throws TException

inlinestatic

Definition at line 70 of file LogRunner.java.

References run_benchmark_import.args, and com.mapd.logrunner.LogRunner.LogRunner().

                                                           {
    logger.info("Hello, World");

    LogRunner x = new LogRunner();
    try {
      x.doWork(args);
    } catch (TTransportException ex) {
      logger.error(ex.toString());
      ex.printStackTrace();
    }
  }

Here is the call graph for this function:

void com.mapd.logrunner.LogRunner.theRest ( OmniSci.Client  client, String  session  ) throws TException

inlineprivate

Definition at line 158 of file LogRunner.java.

References count, run_benchmark_import.tables, and run_benchmark_import.type.

                                                                                {
    // lets fetch databases from mapd
    List<TDBInfo> dbs = client.get_databases(session);

    for (TDBInfo db : dbs) {
      logger.info("db is " + db.toString());
    }

    // lets fetch tables from mapd
    List<String> tables = client.get_tables(session);

    for (String tab : tables) {
      logger.info("Tables is " + tab);
    }

    // lets get the version
    logger.info("Version " + client.get_version());

    // get table_details
    TTableDetails table_details = client.get_table_details(session, "flights");
    for (TColumnType col : table_details.row_desc) {
      logger.info("col name :" + col.col_name);
      logger.info("\tcol encoding :" + col.col_type.encoding);
      logger.info("\tcol is_array :" + col.col_type.is_array);
      logger.info("\tcol nullable :" + col.col_type.nullable);
      logger.info("\tcol type :" + col.col_type.type);
    }

    // client.set_execution_mode(session, TExecuteMode.CPU);
    logger.info(" -- before query -- ");

    TQueryResult sql_execute = client.sql_execute(session,
            "Select uniquecarrier,flightnum  from flights LIMIT 3;",
            true,
            null,
            -1,
            -1);
    // client.send_sql_execute(session, "Select BRAND  from ACV ;", true);
    // logger.info(" -- before query recv -- ");
    // TQueryResult sql_execute = client.recv_sql_execute();

    logger.info(" -- after query -- ");

    logger.info("TQueryResult execution time is " + sql_execute.getExecution_time_ms());
    logger.info("TQueryResult is " + sql_execute.toString());
    logger.info("TQueryResult getFieldValue is "
            + sql_execute.getFieldValue(TQueryResult._Fields.ROW_SET));

    TRowSet row_set = sql_execute.getRow_set();
    Object fieldValue = sql_execute.getFieldValue(TQueryResult._Fields.ROW_SET);

    logger.info("fieldValue " + fieldValue);

    logger.info("TRowSet is " + row_set.toString());

    logger.info("Get rows size " + row_set.getRowsSize());
    logger.info("Get col size " + row_set.getRowsSize());

    List<TRow> rows = row_set.getRows();
    int count = 1;
    for (TRow row : rows) {
      List<TDatum> cols = row.getCols();
      if (cols != null) {
        for (TDatum dat : cols) {
          logger.info("ROW " + count + " " + dat.getFieldValue(TDatum._Fields.VAL));
        }
        count++;
      }
    }

    List<TColumn> columns = row_set.getColumns();

    logger.info("columns " + columns);
    count = 1;
    for (TColumn col : columns) {
      TColumnData data = col.getData();
      if (data != null) {
        logger.info("COL " + count + " " + data.toString());
      }
      count++;
    }
  }

Member Data Documentation

boolean com.mapd.logrunner.LogRunner.cpuMode = false

private

Definition at line 68 of file LogRunner.java.

Referenced by com.mapd.logrunner.LogRunner.myThread.run().

boolean com.mapd.logrunner.LogRunner.gpuMode = false

private

Definition at line 67 of file LogRunner.java.

Referenced by com.mapd.logrunner.LogRunner.myThread.run().

HashMap<Integer, String> com.mapd.logrunner.LogRunner.json

private

Definition at line 66 of file LogRunner.java.

Referenced by com.mapd.logrunner.LogRunner.LogRunner().

final Logger com.mapd.logrunner.LogRunner.logger = LoggerFactory.getLogger(LogRunner.class)

staticpackage

Definition at line 63 of file LogRunner.java.

HashMap<Integer, String> com.mapd.logrunner.LogRunner.originalSql

private

Definition at line 65 of file LogRunner.java.

Referenced by com.mapd.logrunner.LogRunner.LogRunner().

HashMap<Integer, String> com.mapd.logrunner.LogRunner.sqlquery

private

Definition at line 64 of file LogRunner.java.

Referenced by com.mapd.logrunner.LogRunner.LogRunner().

---

The documentation for this class was generated from the following file:

• /home/jenkins-slave/workspace/core-os-doxygen/java/utility/src/main/java/com/mapd/logrunner/LogRunner.java