com.mapd.metadata.MetaConnect Class Reference

Collaboration diagram for com.mapd.metadata.MetaConnect:

Public Member Functions
	MetaConnect (int mapdPort, String dataDir, MapDUser currentMapDUser, MapDParser parser, SockTransportProperties skT)
Table	getTable (String tableName)
Set< String >	getTables ()
TTableDetails	get_table_details (String tableName)
void	updateMetaData (String schema, String table)

Static Public Member Functions
static final int	get_physical_cols (int type)
static final boolean	is_geometry (int type)

Static Package Attributes
static final Logger	MAPDLOGGER = LoggerFactory.getLogger(MetaConnect.class)

Private Member Functions
void	connectToDBCatalog ()
void	disconnectFromDBCatalog ()
Set< String >	getTables_SQL ()
TTableDetails	get_table_detail_SQL (String tableName)
TTableDetails	get_table_detail_JSON (String tableName) throws IOException, RuntimeException
int	getTableId (String tableName)
boolean	isView (String tableName)
String	getViewSql (String tableName)
String	getViewSqlViaSql (int tableId)
TDatumType	typeToThrift (int type)

Private Attributes
final String	dataDir
final String	db
final MapDUser	currentUser
final int	mapdPort
Connection	catConn
final MapDParser	parser
final SockTransportProperties	sock_transport_properties

Static Private Attributes
static final int	KBOOLEAN = 1
static final int	KCHAR = 2
static final int	KVARCHAR = 3
static final int	KNUMERIC = 4
static final int	KDECIMAL = 5
static final int	KINT = 6
static final int	KSMALLINT = 7
static final int	KFLOAT = 8
static final int	KDOUBLE = 9
static final int	KTIME = 10
static final int	KTIMESTAMP = 11
static final int	KBIGINT = 12
static final int	KTEXT = 13
static final int	KDATE = 14
static final int	KARRAY = 15
static final int	KINTERVAL_DAY_TIME = 16
static final int	KINTERVAL_YEAR_MONTH = 17
static final int	KPOINT = 18
static final int	KLINESTRING = 19
static final int	KPOLYGON = 20
static final int	KMULTIPOLYGON = 21
static final int	KTINYINT = 22
static volatile Map< String, Set< String > >	MAPD_DATABASE_TO_TABLES
static volatile Map< List < String >, Table >	MAPD_TABLE_DETAILS

Detailed Description

Author

michael

Definition at line 66 of file MetaConnect.java.

Constructor & Destructor Documentation

com.mapd.metadata.MetaConnect.MetaConnect ( int  mapdPort, String  dataDir, MapDUser  currentMapDUser, MapDParser  parser, SockTransportProperties  skT  )

inline

Definition at line 104 of file MetaConnect.java.

References com.mapd.metadata.MetaConnect.dataDir, com.mapd.metadata.MetaConnect.mapdPort, and com.mapd.metadata.MetaConnect.parser.

                                       {
    this.dataDir = dataDir;
    if (currentMapDUser != null) {
      this.db = currentMapDUser.getDB();
    } else {
      this.db = null;
    }
    this.currentUser = currentMapDUser;
    this.mapdPort = mapdPort;
    this.parser = parser;
    this.sock_transport_properties = skT;
  }

Member Function Documentation

void com.mapd.metadata.MetaConnect.connectToDBCatalog ( )

inlineprivate

Definition at line 121 of file MetaConnect.java.

References com.mapd.metadata.MetaConnect.catConn, com.mapd.metadata.MetaConnect.dataDir, and com.mapd.metadata.MetaConnect.db.

Referenced by com.mapd.metadata.MetaConnect.get_table_details(), com.mapd.metadata.MetaConnect.getTables(), com.mapd.metadata.MetaConnect.getTables_SQL(), and com.mapd.metadata.MetaConnect.getViewSql().

                                    {
    try {
      // try {
      Class.forName("org.sqlite.JDBC");
    } catch (ClassNotFoundException ex) {
      String err = "Could not find class for metadata connection; DB: '" + db
              + "' data dir '" + dataDir + "', error was " + ex.getMessage();
      MAPDLOGGER.error(err);
      throw new RuntimeException(err);
    }
    String connectURL = "jdbc:sqlite:" + dataDir + "/mapd_catalogs/" + db;
    try {
      catConn = DriverManager.getConnection(connectURL);
    } catch (SQLException ex) {
      String err = "Could not establish a connection for metadata; DB: '" + db
              + "' data dir '" + dataDir + "', error was " + ex.getMessage();
      MAPDLOGGER.error(err);
      throw new RuntimeException(err);
    }
    MAPDLOGGER.debug("Opened database successfully");
  }

Here is the caller graph for this function:

void com.mapd.metadata.MetaConnect.disconnectFromDBCatalog ( )

inlineprivate

Definition at line 143 of file MetaConnect.java.

References com.mapd.metadata.MetaConnect.dataDir, and com.mapd.metadata.MetaConnect.db.

Referenced by com.mapd.metadata.MetaConnect.get_table_details(), com.mapd.metadata.MetaConnect.getTables(), com.mapd.metadata.MetaConnect.getTables_SQL(), and com.mapd.metadata.MetaConnect.getViewSql().

                                         {
    try {
      catConn.close();
    } catch (SQLException ex) {
      String err = "Could not disconnect for metadata; DB: '" + db + "' data dir '"
              + dataDir + "', error was " + ex.getMessage();
      MAPDLOGGER.error(err);
      throw new RuntimeException(err);
    }
  }

Here is the caller graph for this function:

static final int com.mapd.metadata.MetaConnect.get_physical_cols ( int  type )

inlinestatic

Definition at line 323 of file MetaConnect.java.

References com.mapd.metadata.MetaConnect.KLINESTRING, com.mapd.metadata.MetaConnect.KMULTIPOLYGON, com.mapd.metadata.MetaConnect.KPOINT, and com.mapd.metadata.MetaConnect.KPOLYGON.

Referenced by com.mapd.metadata.MetaConnect.get_table_detail_JSON(), and com.mapd.metadata.MetaConnect.get_table_detail_SQL().

                                                      {
    switch (type) {
      case KPOINT:
        return 1; // coords
      case KLINESTRING:
        return 2; // coords, bounds
      case KPOLYGON:
        return 4; // coords, ring_sizes, bounds, render_group
      case KMULTIPOLYGON:
        return 5; // coords, ring_sizes, poly_rings, bounds, render_group
      default:
        break;
    }
    return 0;
  }

Here is the caller graph for this function:

TTableDetails com.mapd.metadata.MetaConnect.get_table_detail_JSON ( String  tableName ) throws IOException, RuntimeException

inlineprivate

Definition at line 445 of file MetaConnect.java.

References assert(), com.mapd.metadata.MetaConnect.dataDir, com.mapd.metadata.MetaConnect.db, com.mapd.metadata.MetaConnect.get_physical_cols(), com.mapd.metadata.MetaConnect.is_geometry(), com.mapd.metadata.MetaConnect.KARRAY, and com.mapd.metadata.MetaConnect.typeToThrift().

Referenced by com.mapd.metadata.MetaConnect.get_table_detail_SQL().

                                               {
    TTableDetails td = new TTableDetails();
    td.getRow_descIterator();

    // open table json file
    final String filePath = dataDir + "/mapd_catalogs/" + db + "_temp_tables.json";
    MAPDLOGGER.debug("Opening temp table file at " + filePath);

    String tempTablesJsonStr;
    try {
      File tempTablesFile = new File(filePath);
      FileInputStream tempTablesStream = new FileInputStream(tempTablesFile);
      byte[] data = new byte[(int) tempTablesFile.length()];
      tempTablesStream.read(data);
      tempTablesStream.close();

      tempTablesJsonStr = new String(data, "UTF-8");
    } catch (java.io.FileNotFoundException e) {
      throw new RuntimeException("Failed to read temporary tables file.");
    }

    Gson gson = new Gson();
    JsonObject fileParentObject = gson.fromJson(tempTablesJsonStr, JsonObject.class);
    if (fileParentObject == null) {
      throw new IOException("Malformed temporary tables file.");
    }

    JsonObject tableObject = fileParentObject.getAsJsonObject(tableName);
    if (tableObject == null) {
      throw new RuntimeException(
              "Failed to find table " + tableName + " in temporary tables file.");
    }

    String jsonTableName = tableObject.get("name").getAsString();
    assert (tableName == jsonTableName);
    int id = tableObject.get("id").getAsInt();
    MAPDLOGGER.debug("table id is " + id);
    MAPDLOGGER.debug("table name is " + tableName);

    JsonArray jsonColumns = tableObject.getAsJsonArray("columns");
    assert (jsonColumns != null);

    int skip_physical_cols = 0;
    for (JsonElement columnElement : jsonColumns) {
      JsonObject columnObject = columnElement.getAsJsonObject();

      String colName = columnObject.get("name").getAsString();
      MAPDLOGGER.debug("name = " + colName);
      int colType = columnObject.get("coltype").getAsInt();
      MAPDLOGGER.debug("coltype = " + colType);
      int colSubType = columnObject.get("colsubtype").getAsInt();
      MAPDLOGGER.debug("colsubtype = " + colSubType);
      int colDim = columnObject.get("coldim").getAsInt();
      MAPDLOGGER.debug("coldim = " + colDim);
      int colScale = columnObject.get("colscale").getAsInt();
      MAPDLOGGER.debug("colscale = " + colScale);
      boolean isNotNull = columnObject.get("is_notnull").getAsBoolean();
      MAPDLOGGER.debug("is_notnull = " + isNotNull);
      boolean isSystemCol = columnObject.get("is_systemcol").getAsBoolean();
      MAPDLOGGER.debug("is_systemcol = " + isSystemCol);
      boolean isVirtualCol = columnObject.get("is_virtualcol").getAsBoolean();
      MAPDLOGGER.debug("is_vitrualcol = " + isVirtualCol);
      boolean isDeletedCol = columnObject.get("is_deletedcol").getAsBoolean();
      MAPDLOGGER.debug("is_deletedcol = " + isDeletedCol);
      MAPDLOGGER.debug("");

      if (isDeletedCol) {
        MAPDLOGGER.debug("Skipping delete column.");
        continue;
      }

      TColumnType tct = new TColumnType();
      TTypeInfo tti = new TTypeInfo();
      TDatumType tdt;

      if (colType == KARRAY) {
        tti.is_array = true;
        tdt = typeToThrift(colSubType);
      } else {
        tti.is_array = false;
        tdt = typeToThrift(colType);
      }

      tti.nullable = !isNotNull;
      tti.encoding = TEncodingType.NONE;
      tti.type = tdt;
      tti.scale = colScale;
      tti.precision = colDim;

      tct.col_name = colName;
      tct.col_type = tti;
      tct.is_system = isSystemCol;

      if (skip_physical_cols <= 0) skip_physical_cols = get_physical_cols(colType);
      if (is_geometry(colType) || skip_physical_cols-- <= 0) td.addToRow_desc(tct);
    }

    return td;
  }

Here is the call graph for this function:

Here is the caller graph for this function:

TTableDetails com.mapd.metadata.MetaConnect.get_table_detail_SQL ( String  tableName )

inlineprivate

Definition at line 344 of file MetaConnect.java.

References com.mapd.metadata.MetaConnect.db, com.mapd.metadata.MetaConnect.get_physical_cols(), com.mapd.metadata.MetaConnect.get_table_detail_JSON(), com.mapd.metadata.MetaConnect.getTableId(), com.mapd.metadata.MetaConnect.getViewSqlViaSql(), com.mapd.metadata.MetaConnect.is_geometry(), com.mapd.metadata.MetaConnect.isView(), com.mapd.metadata.MetaConnect.KARRAY, and com.mapd.metadata.MetaConnect.typeToThrift().

Referenced by com.mapd.metadata.MetaConnect.get_table_details().

                                                               {
    TTableDetails td = new TTableDetails();
    td.getRow_descIterator();
    int id = getTableId(tableName);
    if (id == -1) {
      try {
        return get_table_detail_JSON(tableName);
      } catch (Exception e) {
        String err = "Table '" + tableName + "' does not exist for DB '" + db + "'";
        MAPDLOGGER.error(err);
        throw new RuntimeException(err);
      }
    }

    // read data from table
    Statement stmt = null;
    ResultSet rs = null;
    try {
      stmt = catConn.createStatement();
      MAPDLOGGER.debug("table id is " + id);
      MAPDLOGGER.debug("table name is " + tableName);
      String query = String.format(
              "SELECT * FROM mapd_columns where tableid = %d and not is_deletedcol order by columnid;",
              id);
      MAPDLOGGER.debug(query);
      rs = stmt.executeQuery(query);
      int skip_physical_cols = 0;
      while (rs.next()) {
        String colName = rs.getString("name");
        MAPDLOGGER.debug("name = " + colName);
        int colType = rs.getInt("coltype");
        MAPDLOGGER.debug("coltype = " + colType);
        int colSubType = rs.getInt("colsubtype");
        MAPDLOGGER.debug("colsubtype = " + colSubType);
        int colDim = rs.getInt("coldim");
        MAPDLOGGER.debug("coldim = " + colDim);
        int colScale = rs.getInt("colscale");
        MAPDLOGGER.debug("colscale = " + colScale);
        boolean isNotNull = rs.getBoolean("is_notnull");
        MAPDLOGGER.debug("is_notnull = " + isNotNull);
        boolean isSystemCol = rs.getBoolean("is_systemcol");
        MAPDLOGGER.debug("is_systemcol = " + isSystemCol);
        boolean isVirtualCol = rs.getBoolean("is_virtualcol");
        MAPDLOGGER.debug("is_vitrualcol = " + isVirtualCol);
        MAPDLOGGER.debug("");
        TColumnType tct = new TColumnType();
        TTypeInfo tti = new TTypeInfo();
        TDatumType tdt;

        if (colType == KARRAY) {
          tti.is_array = true;
          tdt = typeToThrift(colSubType);
        } else {
          tti.is_array = false;
          tdt = typeToThrift(colType);
        }

        tti.nullable = !isNotNull;
        tti.encoding = TEncodingType.NONE;
        tti.type = tdt;
        tti.scale = colScale;
        tti.precision = colDim;

        tct.col_name = colName;
        tct.col_type = tti;
        tct.is_system = isSystemCol;

        if (skip_physical_cols <= 0) skip_physical_cols = get_physical_cols(colType);
        if (is_geometry(colType) || skip_physical_cols-- <= 0) td.addToRow_desc(tct);
      }
    } catch (Exception e) {
      String err = "error trying to read from mapd_columns, error was " + e.getMessage();
      MAPDLOGGER.error(err);
      throw new RuntimeException(err);
    } finally {
      if (rs != null) {
        try {
          rs.close();
        } catch (SQLException ex) {
          String err = "Could not close resultset, error was " + ex.getMessage();
          MAPDLOGGER.error(err);
          throw new RuntimeException(err);
        }
      }
      if (stmt != null) {
        try {
          stmt.close();
        } catch (SQLException ex) {
          String err = "Could not close stmt, error was " + ex.getMessage();
          MAPDLOGGER.error(err);
          throw new RuntimeException(err);
        }
      }
    }
    if (isView(tableName)) {
      td.setView_sqlIsSet(true);
      td.setView_sql(getViewSqlViaSql(id));
    }
    return td;
  }

Here is the call graph for this function:

Here is the caller graph for this function:

TTableDetails com.mapd.metadata.MetaConnect.get_table_details ( String  tableName )

inline

Definition at line 285 of file MetaConnect.java.

References com.mapd.metadata.MetaConnect.connectToDBCatalog(), com.mapd.metadata.MetaConnect.disconnectFromDBCatalog(), com.mapd.metadata.MetaConnect.get_table_detail_SQL(), and com.mapd.metadata.MetaConnect.mapdPort.

Referenced by com.mapd.metadata.MetaConnect.getTable().

                                                           {
    if (mapdPort == -1) {
      // use sql
      connectToDBCatalog();
      TTableDetails td = get_table_detail_SQL(tableName);
      disconnectFromDBCatalog();
      return td;
    }
    // use thrift direct to local server
    try {
      TProtocol protocol = null;

      TTransport transport =
              sock_transport_properties.openClientTransport("localhost", mapdPort);
      if (!transport.isOpen()) transport.open();
      protocol = new TBinaryProtocol(transport);

      OmniSci.Client client = new OmniSci.Client(protocol);

      TTableDetails td =
              client.get_internal_table_details(currentUser.getSession(), tableName);

      transport.close();

      return td;

    } catch (TTransportException ex) {
      MAPDLOGGER.error(ex.toString());
      throw new RuntimeException(ex.toString());
    } catch (TOmniSciException ex) {
      MAPDLOGGER.error(ex.toString());
      throw new RuntimeException(ex.toString());
    } catch (TException ex) {
      MAPDLOGGER.error(ex.toString());
      throw new RuntimeException(ex.toString());
    }
  }

Here is the call graph for this function:

Here is the caller graph for this function:

Table com.mapd.metadata.MetaConnect.getTable ( String  tableName )

inline

Definition at line 154 of file MetaConnect.java.

References com.mapd.metadata.MetaConnect.get_table_details(), com.mapd.metadata.MetaConnect.getViewSql(), and com.mapd.metadata.MetaConnect.parser.

                                          {
    List<String> dbTable = ImmutableList.of(db.toUpperCase(), tableName.toUpperCase());
    Table cTable = MAPD_TABLE_DETAILS.get(dbTable);
    if (cTable != null) {
      return cTable;
    }

    TTableDetails td = get_table_details(tableName);

    if (td.getView_sql() == null || td.getView_sql().isEmpty()) {
      MAPDLOGGER.debug("Processing a table");
      Table rTable = new MapDTable(td);
      MAPD_TABLE_DETAILS.putIfAbsent(dbTable, rTable);
      return rTable;
    } else {
      MAPDLOGGER.debug("Processing a view");
      Table rTable = new MapDView(getViewSql(tableName), td, parser);
      MAPD_TABLE_DETAILS.putIfAbsent(dbTable, rTable);
      return rTable;
    }
  }

Here is the call graph for this function:

int com.mapd.metadata.MetaConnect.getTableId ( String  tableName )

inlineprivate

Definition at line 546 of file MetaConnect.java.

References com.mapd.metadata.MetaConnect.dataDir, and com.mapd.metadata.MetaConnect.db.

Referenced by com.mapd.metadata.MetaConnect.get_table_detail_SQL(), and com.mapd.metadata.MetaConnect.getViewSql().

                                           {
    Statement stmt = null;
    ResultSet rs = null;
    int tableId = -1;
    try {
      stmt = catConn.createStatement();
      rs = stmt.executeQuery(String.format(
              "SELECT tableid FROM mapd_tables where name = '%s' COLLATE NOCASE;",
              tableName));
      while (rs.next()) {
        tableId = rs.getInt("tableid");
        MAPDLOGGER.debug("tableId = " + tableId);
        MAPDLOGGER.debug("");
      }
      rs.close();
      stmt.close();
    } catch (Exception e) {
      String err = "Error trying to read from metadata table mapd_tables;DB: " + db
              + " data dir " + dataDir + ", error was " + e.getMessage();
      MAPDLOGGER.error(err);
      throw new RuntimeException(err);
    } finally {
      if (rs != null) {
        try {
          rs.close();
        } catch (SQLException ex) {
          String err = "Could not close resultset, error was " + ex.getMessage();
          MAPDLOGGER.error(err);
          throw new RuntimeException(err);
        }
      }
      if (stmt != null) {
        try {
          stmt.close();
        } catch (SQLException ex) {
          String err = "Could not close stmt, error was " + ex.getMessage();
          MAPDLOGGER.error(err);
          throw new RuntimeException(err);
        }
      }
    }
    return (tableId);
  }

Here is the caller graph for this function:

Set<String> com.mapd.metadata.MetaConnect.getTables ( )

inline

Definition at line 176 of file MetaConnect.java.

References com.mapd.metadata.MetaConnect.connectToDBCatalog(), com.mapd.metadata.MetaConnect.disconnectFromDBCatalog(), com.mapd.metadata.MetaConnect.getTables_SQL(), and com.mapd.metadata.MetaConnect.mapdPort.

                                 {
    Set<String> mSet = MAPD_DATABASE_TO_TABLES.get(db.toUpperCase());
    if (mSet != null) {
      return mSet;
    }

    if (mapdPort == -1) {
      // use sql
      connectToDBCatalog();
      Set<String> ts = getTables_SQL();
      disconnectFromDBCatalog();
      MAPD_DATABASE_TO_TABLES.putIfAbsent(db.toUpperCase(), ts);
      return ts;
    }
    // use thrift direct to local server
    try {
      TProtocol protocol = null;
      TTransport transport =
              sock_transport_properties.openClientTransport("localhost", mapdPort);
      if (!transport.isOpen()) transport.open();
      protocol = new TBinaryProtocol(transport);

      OmniSci.Client client = new OmniSci.Client(protocol);

      List<String> tablesList = client.get_tables(currentUser.getSession());
      Set<String> ts = new HashSet<String>(tablesList.size());
      for (String tableName : tablesList) {
        ts.add(tableName);
      }

      transport.close();
      MAPD_DATABASE_TO_TABLES.putIfAbsent(db.toUpperCase(), ts);
      return ts;

    } catch (TTransportException ex) {
      MAPDLOGGER.error("TTransportException on port [" + mapdPort + "]");
      MAPDLOGGER.error(ex.toString());
      throw new RuntimeException(ex.toString());
    } catch (TOmniSciException ex) {
      MAPDLOGGER.error(ex.toString());
      throw new RuntimeException(ex.toString());
    } catch (TException ex) {
      MAPDLOGGER.error(ex.toString());
      throw new RuntimeException(ex.toString());
    }
  }

Here is the call graph for this function:

Set<String> com.mapd.metadata.MetaConnect.getTables_SQL ( )

inlineprivate

Definition at line 223 of file MetaConnect.java.

References com.mapd.metadata.MetaConnect.connectToDBCatalog(), com.mapd.metadata.MetaConnect.dataDir, com.mapd.metadata.MetaConnect.db, and com.mapd.metadata.MetaConnect.disconnectFromDBCatalog().

Referenced by com.mapd.metadata.MetaConnect.getTables().

                                      {
    connectToDBCatalog();
    Set<String> tableSet = new HashSet<String>();
    Statement stmt = null;
    ResultSet rs = null;
    String sqlText = "";
    try {
      stmt = catConn.createStatement();

      // get the tables
      rs = stmt.executeQuery("SELECT name FROM mapd_tables ");
      while (rs.next()) {
        tableSet.add(rs.getString("name"));
        /*--*/
        MAPDLOGGER.debug("Object name = " + rs.getString("name"));
      }
      rs.close();
      stmt.close();

    } catch (Exception e) {
      String err = "error trying to get all the tables, error was " + e.getMessage();
      MAPDLOGGER.error(err);
      throw new RuntimeException(err);
    }
    disconnectFromDBCatalog();

    try {
      // open temp table json file
      final String filePath = dataDir + "/mapd_catalogs/" + db + "_temp_tables.json";
      MAPDLOGGER.debug("Opening temp table file at " + filePath);
      String tempTablesJsonStr;
      try {
        File tempTablesFile = new File(filePath);
        FileInputStream tempTablesStream = new FileInputStream(tempTablesFile);
        byte[] data = new byte[(int) tempTablesFile.length()];
        tempTablesStream.read(data);
        tempTablesStream.close();

        tempTablesJsonStr = new String(data, "UTF-8");
      } catch (java.io.FileNotFoundException e) {
        return tableSet;
      }

      Gson gson = new Gson();
      JsonObject fileParentObject = gson.fromJson(tempTablesJsonStr, JsonObject.class);
      for (Entry<String, JsonElement> member : fileParentObject.entrySet()) {
        String tableName = member.getKey();
        tableSet.add(tableName);
        /*--*/
        MAPDLOGGER.debug("Temp table object name = " + tableName);
      }

    } catch (Exception e) {
      String err = "error trying to load temporary tables from json file, error was "
              + e.getMessage();
      MAPDLOGGER.error(err);
      throw new RuntimeException(err);
    }

    return tableSet;
  }

Here is the call graph for this function:

Here is the caller graph for this function:

String com.mapd.metadata.MetaConnect.getViewSql ( String  tableName )

inlineprivate

Definition at line 614 of file MetaConnect.java.

References com.mapd.metadata.MetaConnect.connectToDBCatalog(), com.mapd.metadata.MetaConnect.disconnectFromDBCatalog(), com.mapd.metadata.MetaConnect.getTableId(), com.mapd.metadata.MetaConnect.getViewSqlViaSql(), and com.mapd.metadata.MetaConnect.mapdPort.

Referenced by com.mapd.metadata.MetaConnect.getTable().

                                              {
    String sqlText;
    if (mapdPort == -1) {
      // use sql
      connectToDBCatalog();
      sqlText = getViewSqlViaSql(getTableId(tableName));
      disconnectFromDBCatalog();
    } else {
      // use thrift direct to local server
      try {
        TProtocol protocol = null;

        TTransport transport =
                sock_transport_properties.openClientTransport("localhost", mapdPort);
        if (!transport.isOpen()) transport.open();
        protocol = new TBinaryProtocol(transport);

        OmniSci.Client client = new OmniSci.Client(protocol);

        TTableDetails td = client.get_table_details(currentUser.getSession(), tableName);

        transport.close();

        sqlText = td.getView_sql();

      } catch (TTransportException ex) {
        MAPDLOGGER.error(ex.toString());
        throw new RuntimeException(ex.toString());
      } catch (TOmniSciException ex) {
        MAPDLOGGER.error(ex.toString());
        throw new RuntimeException(ex.toString());
      } catch (TException ex) {
        MAPDLOGGER.error(ex.toString());
        throw new RuntimeException(ex.toString());
      }
    }
    /* return string without the sqlite's trailing semicolon */
    if (sqlText.charAt(sqlText.length() - 1) == ';') {
      return (sqlText.substring(0, sqlText.length() - 1));
    } else {
      return (sqlText);
    }
  }

Here is the call graph for this function:

Here is the caller graph for this function:

String com.mapd.metadata.MetaConnect.getViewSqlViaSql ( int  tableId )

inlineprivate

Definition at line 659 of file MetaConnect.java.

Referenced by com.mapd.metadata.MetaConnect.get_table_detail_SQL(), and com.mapd.metadata.MetaConnect.getViewSql().

                                               {
    Statement stmt;
    ResultSet rs;
    String sqlText = "";
    try {
      stmt = catConn.createStatement();
      rs = stmt.executeQuery(String.format(
              "SELECT sql FROM mapd_views where tableid = '%s' COLLATE NOCASE;",
              tableId));
      while (rs.next()) {
        sqlText = rs.getString("sql");
        MAPDLOGGER.debug("View definition = " + sqlText);
        MAPDLOGGER.debug("");
      }
      rs.close();
      stmt.close();
    } catch (Exception e) {
      String err = "error trying to read from mapd_views, error was " + e.getMessage();
      MAPDLOGGER.error(err);
      throw new RuntimeException(err);
    }
    if (sqlText == null || sqlText.length() == 0) {
      String err = "No view text found";
      MAPDLOGGER.error(err);
      throw new RuntimeException(err);
    }
    return sqlText;
  }

Here is the caller graph for this function:

static final boolean com.mapd.metadata.MetaConnect.is_geometry ( int  type )

inlinestatic

Definition at line 339 of file MetaConnect.java.

References com.mapd.metadata.MetaConnect.KLINESTRING, com.mapd.metadata.MetaConnect.KMULTIPOLYGON, com.mapd.metadata.MetaConnect.KPOINT, and com.mapd.metadata.MetaConnect.KPOLYGON.

Referenced by com.mapd.metadata.MetaConnect.get_table_detail_JSON(), and com.mapd.metadata.MetaConnect.get_table_detail_SQL().

                                                    {
    return type == KPOINT || type == KLINESTRING || type == KPOLYGON
            || type == KMULTIPOLYGON;
  }

Here is the caller graph for this function:

boolean com.mapd.metadata.MetaConnect.isView ( String  tableName )

inlineprivate

Definition at line 590 of file MetaConnect.java.

Referenced by com.mapd.metadata.MetaConnect.get_table_detail_SQL().

                                           {
    Statement stmt;
    ResultSet rs;
    int viewFlag = 0;
    try {
      stmt = catConn.createStatement();
      rs = stmt.executeQuery(String.format(
              "SELECT isview FROM mapd_tables where name = '%s' COLLATE NOCASE;",
              tableName));
      while (rs.next()) {
        viewFlag = rs.getInt("isview");
        MAPDLOGGER.debug("viewFlag = " + viewFlag);
        MAPDLOGGER.debug("");
      }
      rs.close();
      stmt.close();
    } catch (Exception e) {
      String err = "error trying to read from mapd_views, error was " + e.getMessage();
      MAPDLOGGER.error(err);
      throw new RuntimeException(err);
    }
    return (viewFlag == 1);
  }

Here is the caller graph for this function:

TDatumType com.mapd.metadata.MetaConnect.typeToThrift ( int  type )

inlineprivate

Definition at line 688 of file MetaConnect.java.

References com.mapd.metadata.MetaConnect.KBIGINT, com.mapd.metadata.MetaConnect.KBOOLEAN, com.mapd.metadata.MetaConnect.KCHAR, com.mapd.metadata.MetaConnect.KDATE, com.mapd.metadata.MetaConnect.KDECIMAL, com.mapd.metadata.MetaConnect.KDOUBLE, com.mapd.metadata.MetaConnect.KFLOAT, com.mapd.metadata.MetaConnect.KINT, com.mapd.metadata.MetaConnect.KINTERVAL_DAY_TIME, com.mapd.metadata.MetaConnect.KINTERVAL_YEAR_MONTH, com.mapd.metadata.MetaConnect.KLINESTRING, com.mapd.metadata.MetaConnect.KMULTIPOLYGON, com.mapd.metadata.MetaConnect.KNUMERIC, com.mapd.metadata.MetaConnect.KPOINT, com.mapd.metadata.MetaConnect.KPOLYGON, com.mapd.metadata.MetaConnect.KSMALLINT, com.mapd.metadata.MetaConnect.KTEXT, com.mapd.metadata.MetaConnect.KTIME, com.mapd.metadata.MetaConnect.KTIMESTAMP, com.mapd.metadata.MetaConnect.KTINYINT, and com.mapd.metadata.MetaConnect.KVARCHAR.

Referenced by com.mapd.metadata.MetaConnect.get_table_detail_JSON(), and com.mapd.metadata.MetaConnect.get_table_detail_SQL().

                                            {
    switch (type) {
      case KBOOLEAN:
        return TDatumType.BOOL;
      case KTINYINT:
        return TDatumType.TINYINT;
      case KSMALLINT:
        return TDatumType.SMALLINT;
      case KINT:
        return TDatumType.INT;
      case KBIGINT:
        return TDatumType.BIGINT;
      case KFLOAT:
        return TDatumType.FLOAT;
      case KNUMERIC:
      case KDECIMAL:
        return TDatumType.DECIMAL;
      case KDOUBLE:
        return TDatumType.DOUBLE;
      case KTEXT:
      case KVARCHAR:
      case KCHAR:
        return TDatumType.STR;
      case KTIME:
        return TDatumType.TIME;
      case KTIMESTAMP:
        return TDatumType.TIMESTAMP;
      case KDATE:
        return TDatumType.DATE;
      case KINTERVAL_DAY_TIME:
        return TDatumType.INTERVAL_DAY_TIME;
      case KINTERVAL_YEAR_MONTH:
        return TDatumType.INTERVAL_YEAR_MONTH;
      case KPOINT:
        return TDatumType.POINT;
      case KLINESTRING:
        return TDatumType.LINESTRING;
      case KPOLYGON:
        return TDatumType.POLYGON;
      case KMULTIPOLYGON:
        return TDatumType.MULTIPOLYGON;
      default:
        return null;
    }
  }

Here is the caller graph for this function:

void com.mapd.metadata.MetaConnect.updateMetaData ( String  schema, String  table  )

inline

Definition at line 734 of file MetaConnect.java.

References all.

                                                          {
    // Check if table is specified, if not we are dropping an entire DB so need to
    // remove all
    // tables for that DB
    if (table.equals("")) {
      // Drop db and all tables
      // iterate through all and remove matching schema
      Set<List<String>> all = new HashSet<>(MAPD_TABLE_DETAILS.keySet());
      for (List<String> keys : all) {
        if (keys.get(0).equals(schema.toUpperCase())) {
          MAPDLOGGER.debug("removing schema " + keys.get(0) + " table " + keys.get(1));
          MAPD_TABLE_DETAILS.remove(keys);
        }
      }
    } else {
      MAPDLOGGER.debug("removing schema " + schema.toUpperCase() + " table "
              + table.toUpperCase());
      MAPD_TABLE_DETAILS.remove(
              ImmutableList.of(schema.toUpperCase(), table.toUpperCase()));
    }
    // Invalidate views
    Set<List<String>> all = new HashSet<>(MAPD_TABLE_DETAILS.keySet());
    for (List<String> keys : all) {
      if (keys.get(0).equals(schema.toUpperCase())) {
        Table ttable = MAPD_TABLE_DETAILS.get(keys);
        if (ttable instanceof MapDView) {
          MAPDLOGGER.debug(
                  "removing view in schema " + keys.get(0) + " view " + keys.get(1));
          MAPD_TABLE_DETAILS.remove(keys);
        }
      }
    }
    // now remove schema
    MAPDLOGGER.debug("removing schema " + schema.toUpperCase());
    MAPD_DATABASE_TO_TABLES.remove(schema.toUpperCase());
  }

Member Data Documentation

Connection com.mapd.metadata.MetaConnect.catConn

private

Definition at line 72 of file MetaConnect.java.

Referenced by com.mapd.metadata.MetaConnect.connectToDBCatalog().

final MapDUser com.mapd.metadata.MetaConnect.currentUser

private

Definition at line 70 of file MetaConnect.java.

final String com.mapd.metadata.MetaConnect.dataDir

private

Definition at line 68 of file MetaConnect.java.

Referenced by com.mapd.metadata.MetaConnect.connectToDBCatalog(), com.mapd.metadata.MetaConnect.disconnectFromDBCatalog(), com.mapd.metadata.MetaConnect.get_table_detail_JSON(), com.mapd.metadata.MetaConnect.getTableId(), com.mapd.metadata.MetaConnect.getTables_SQL(), and com.mapd.metadata.MetaConnect.MetaConnect().

final String com.mapd.metadata.MetaConnect.db

private

Definition at line 69 of file MetaConnect.java.

Referenced by com.mapd.metadata.MetaConnect.connectToDBCatalog(), com.mapd.metadata.MetaConnect.disconnectFromDBCatalog(), com.mapd.metadata.MetaConnect.get_table_detail_JSON(), com.mapd.metadata.MetaConnect.get_table_detail_SQL(), com.mapd.metadata.MetaConnect.getTableId(), and com.mapd.metadata.MetaConnect.getTables_SQL().

final int com.mapd.metadata.MetaConnect.KARRAY = 15

staticprivate

Definition at line 89 of file MetaConnect.java.

Referenced by com.mapd.metadata.MetaConnect.get_table_detail_JSON(), and com.mapd.metadata.MetaConnect.get_table_detail_SQL().

final int com.mapd.metadata.MetaConnect.KBIGINT = 12

staticprivate

Definition at line 86 of file MetaConnect.java.

Referenced by com.mapd.metadata.MetaConnect.typeToThrift().

final int com.mapd.metadata.MetaConnect.KBOOLEAN = 1

staticprivate

Definition at line 75 of file MetaConnect.java.

Referenced by com.mapd.metadata.MetaConnect.typeToThrift().

final int com.mapd.metadata.MetaConnect.KCHAR = 2

staticprivate

Definition at line 76 of file MetaConnect.java.

Referenced by com.mapd.metadata.MetaConnect.typeToThrift().

final int com.mapd.metadata.MetaConnect.KDATE = 14

staticprivate

Definition at line 88 of file MetaConnect.java.

Referenced by com.mapd.metadata.MetaConnect.typeToThrift().

final int com.mapd.metadata.MetaConnect.KDECIMAL = 5

staticprivate

Definition at line 79 of file MetaConnect.java.

Referenced by com.mapd.metadata.MetaConnect.typeToThrift().

final int com.mapd.metadata.MetaConnect.KDOUBLE = 9

staticprivate

Definition at line 83 of file MetaConnect.java.

Referenced by com.mapd.metadata.MetaConnect.typeToThrift().

final int com.mapd.metadata.MetaConnect.KFLOAT = 8

staticprivate

Definition at line 82 of file MetaConnect.java.

Referenced by com.mapd.metadata.MetaConnect.typeToThrift().

final int com.mapd.metadata.MetaConnect.KINT = 6

staticprivate

Definition at line 80 of file MetaConnect.java.

Referenced by com.mapd.metadata.MetaConnect.typeToThrift().

final int com.mapd.metadata.MetaConnect.KINTERVAL_DAY_TIME = 16

staticprivate

Definition at line 90 of file MetaConnect.java.

Referenced by com.mapd.metadata.MetaConnect.typeToThrift().

final int com.mapd.metadata.MetaConnect.KINTERVAL_YEAR_MONTH = 17

staticprivate

Definition at line 91 of file MetaConnect.java.

Referenced by com.mapd.metadata.MetaConnect.typeToThrift().

final int com.mapd.metadata.MetaConnect.KLINESTRING = 19

staticprivate

Definition at line 93 of file MetaConnect.java.

Referenced by com.mapd.metadata.MetaConnect.get_physical_cols(), com.mapd.metadata.MetaConnect.is_geometry(), and com.mapd.metadata.MetaConnect.typeToThrift().

final int com.mapd.metadata.MetaConnect.KMULTIPOLYGON = 21

staticprivate

Definition at line 95 of file MetaConnect.java.

Referenced by com.mapd.metadata.MetaConnect.get_physical_cols(), com.mapd.metadata.MetaConnect.is_geometry(), and com.mapd.metadata.MetaConnect.typeToThrift().

final int com.mapd.metadata.MetaConnect.KNUMERIC = 4

staticprivate

Definition at line 78 of file MetaConnect.java.

Referenced by com.mapd.metadata.MetaConnect.typeToThrift().

final int com.mapd.metadata.MetaConnect.KPOINT = 18

staticprivate

Definition at line 92 of file MetaConnect.java.

Referenced by com.mapd.metadata.MetaConnect.get_physical_cols(), com.mapd.metadata.MetaConnect.is_geometry(), and com.mapd.metadata.MetaConnect.typeToThrift().

final int com.mapd.metadata.MetaConnect.KPOLYGON = 20

staticprivate

Definition at line 94 of file MetaConnect.java.

Referenced by com.mapd.metadata.MetaConnect.get_physical_cols(), com.mapd.metadata.MetaConnect.is_geometry(), and com.mapd.metadata.MetaConnect.typeToThrift().

final int com.mapd.metadata.MetaConnect.KSMALLINT = 7

staticprivate

Definition at line 81 of file MetaConnect.java.

Referenced by com.mapd.metadata.MetaConnect.typeToThrift().

final int com.mapd.metadata.MetaConnect.KTEXT = 13

staticprivate

Definition at line 87 of file MetaConnect.java.

Referenced by com.mapd.metadata.MetaConnect.typeToThrift().

final int com.mapd.metadata.MetaConnect.KTIME = 10

staticprivate

Definition at line 84 of file MetaConnect.java.

Referenced by com.mapd.metadata.MetaConnect.typeToThrift().

final int com.mapd.metadata.MetaConnect.KTIMESTAMP = 11

staticprivate

Definition at line 85 of file MetaConnect.java.

Referenced by com.mapd.metadata.MetaConnect.typeToThrift().

final int com.mapd.metadata.MetaConnect.KTINYINT = 22

staticprivate

Definition at line 96 of file MetaConnect.java.

Referenced by com.mapd.metadata.MetaConnect.typeToThrift().

final int com.mapd.metadata.MetaConnect.KVARCHAR = 3

staticprivate

Definition at line 77 of file MetaConnect.java.

Referenced by com.mapd.metadata.MetaConnect.typeToThrift().

volatile Map<String, Set<String> > com.mapd.metadata.MetaConnect.MAPD_DATABASE_TO_TABLES

staticprivate

Initial value:

=
          new ConcurrentHashMap<>()

Definition at line 98 of file MetaConnect.java.

volatile Map<List<String>, Table> com.mapd.metadata.MetaConnect.MAPD_TABLE_DETAILS

staticprivate

Initial value:

=
          new ConcurrentHashMap<>()

Definition at line 100 of file MetaConnect.java.

final Logger com.mapd.metadata.MetaConnect.MAPDLOGGER = LoggerFactory.getLogger(MetaConnect.class)

staticpackage

Definition at line 67 of file MetaConnect.java.

final int com.mapd.metadata.MetaConnect.mapdPort

private

Definition at line 71 of file MetaConnect.java.

Referenced by com.mapd.metadata.MetaConnect.get_table_details(), com.mapd.metadata.MetaConnect.getTables(), com.mapd.metadata.MetaConnect.getViewSql(), and com.mapd.metadata.MetaConnect.MetaConnect().

final MapDParser com.mapd.metadata.MetaConnect.parser

private

Definition at line 73 of file MetaConnect.java.

Referenced by com.mapd.metadata.MetaConnect.getTable(), and com.mapd.metadata.MetaConnect.MetaConnect().

final SockTransportProperties com.mapd.metadata.MetaConnect.sock_transport_properties

private

Definition at line 102 of file MetaConnect.java.

---

The documentation for this class was generated from the following file:

• /home/jenkins-slave/workspace/core-os-doxygen/java/calcite/src/main/java/com/mapd/metadata/MetaConnect.java