Collaboration diagram for com.mapd.metadata.MetaConnect:

Public Member Functions
	MetaConnect (int mapdPort, String dataDir, MapDUser currentMapDUser, MapDParser parser, SockTransportProperties skT)

Table	getTable (String tableName)

Set< String >	getTables ()

TTableDetails	get_table_details (String tableName)

void	updateMetaData (String schema, String table)

Static Public Member Functions
static final int	get_physical_cols (int type)

static final boolean	is_geometry (int type)

Static Package Attributes
static final Logger	MAPDLOGGER = LoggerFactory.getLogger(MetaConnect.class)

Private Member Functions
void	connectToDBCatalog ()

void	disconnectFromDBCatalog ()

Set< String >	getTables_SQL ()

TTableDetails	get_table_detail_SQL (String tableName)

TTableDetails	get_table_detail_JSON (String tableName) throws IOException, RuntimeException

int	getTableId (String tableName)

boolean	isView (String tableName)

String	getViewSql (String tableName)

String	getViewSqlViaSql (int tableId)

TDatumType	typeToThrift (int type)

Private Attributes
final String	dataDir

final String	db

final MapDUser	currentUser

final int	mapdPort

Connection	catConn

final MapDParser	parser

final SockTransportProperties	sock_transport_properties

Static Private Attributes
static final int	KBOOLEAN = 1

static final int	KCHAR = 2

static final int	KVARCHAR = 3

static final int	KNUMERIC = 4

static final int	KDECIMAL = 5

static final int	KINT = 6

static final int	KSMALLINT = 7

static final int	KFLOAT = 8

static final int	KDOUBLE = 9

static final int	KTIME = 10

static final int	KTIMESTAMP = 11

static final int	KBIGINT = 12

static final int	KTEXT = 13

static final int	KDATE = 14

static final int	KARRAY = 15

static final int	KINTERVAL_DAY_TIME = 16

static final int	KINTERVAL_YEAR_MONTH = 17

static final int	KPOINT = 18

static final int	KLINESTRING = 19

static final int	KPOLYGON = 20

static final int	KMULTIPOLYGON = 21

static final int	KTINYINT = 22

static volatile Map< String, Set< String > >	MAPD_DATABASE_TO_TABLES

static volatile Map< List< String >, Table >	MAPD_TABLE_DETAILS

Detailed Description

Author: michael

Definition at line 66 of file MetaConnect.java.

Constructor & Destructor Documentation

◆ MetaConnect()

com.mapd.metadata.MetaConnect.MetaConnect	(	int	mapdPort,
		String	dataDir,
		MapDUser	currentMapDUser,
		MapDParser	parser,
		SockTransportProperties	skT
	)

inline

Definition at line 104 of file MetaConnect.java.

References com.mapd.metadata.MetaConnect.dataDir, com.mapd.calcite.parser.MapDUser.getDB(), com.mapd.metadata.MetaConnect.mapdPort, and com.mapd.metadata.MetaConnect.parser.

                                        {
     this.dataDir = dataDir;
     if (currentMapDUser != null) {
       this.db = currentMapDUser.getDB();
     } else {
       this.db = null;
     }
     this.currentUser = currentMapDUser;
     this.mapdPort = mapdPort;
     this.parser = parser;
     this.sock_transport_properties = skT;
   }

Here is the call graph for this function:

Member Function Documentation

◆ connectToDBCatalog()

void com.mapd.metadata.MetaConnect.connectToDBCatalog ( )

inlineprivate

Definition at line 121 of file MetaConnect.java.

References com.mapd.metadata.MetaConnect.db.

Referenced by com.mapd.metadata.MetaConnect.get_table_details(), com.mapd.metadata.MetaConnect.getTables(), com.mapd.metadata.MetaConnect.getTables_SQL(), and com.mapd.metadata.MetaConnect.getViewSql().

                                     {
     try {
       // try {
       Class.forName("org.sqlite.JDBC");
     } catch (ClassNotFoundException ex) {
       String err = "Could not find class for metadata connection; DB: '" + db
               + "' data dir '" + dataDir + "', error was " + ex.getMessage();
       MAPDLOGGER.error(err);
       throw new RuntimeException(err);
     }
     String connectURL = "jdbc:sqlite:" + dataDir + "/mapd_catalogs/" + db;
     try {
       catConn = DriverManager.getConnection(connectURL);
     } catch (SQLException ex) {
       String err = "Could not establish a connection for metadata; DB: '" + db
               + "' data dir '" + dataDir + "', error was " + ex.getMessage();
       MAPDLOGGER.error(err);
       throw new RuntimeException(err);
     }
     MAPDLOGGER.debug("Opened database successfully");
   }

Here is the caller graph for this function:

◆ disconnectFromDBCatalog()

void com.mapd.metadata.MetaConnect.disconnectFromDBCatalog ( )

inlineprivate

Definition at line 143 of file MetaConnect.java.

Referenced by com.mapd.metadata.MetaConnect.get_table_details(), com.mapd.metadata.MetaConnect.getTables(), com.mapd.metadata.MetaConnect.getTables_SQL(), and com.mapd.metadata.MetaConnect.getViewSql().

                                          {
     try {
       catConn.close();
     } catch (SQLException ex) {
       String err = "Could not disconnect for metadata; DB: '" + db + "' data dir '"
               + dataDir + "', error was " + ex.getMessage();
       MAPDLOGGER.error(err);
       throw new RuntimeException(err);
     }
   }

Here is the caller graph for this function:

◆ get_physical_cols()

static final int com.mapd.metadata.MetaConnect.get_physical_cols ( int type )

inlinestatic

Definition at line 323 of file MetaConnect.java.

References com.mapd.metadata.MetaConnect.KLINESTRING, com.mapd.metadata.MetaConnect.KMULTIPOLYGON, com.mapd.metadata.MetaConnect.KPOINT, and com.mapd.metadata.MetaConnect.KPOLYGON.

Referenced by com.mapd.metadata.MetaConnect.get_table_detail_JSON(), and com.mapd.metadata.MetaConnect.get_table_detail_SQL().

                                                       {
     switch (type) {
       case KPOINT:
         return 1; // coords
       case KLINESTRING:
         return 2; // coords, bounds
       case KPOLYGON:
         return 4; // coords, ring_sizes, bounds, render_group
       case KMULTIPOLYGON:
         return 5; // coords, ring_sizes, poly_rings, bounds, render_group
       default:
         break;
     }
     return 0;
   }

Here is the caller graph for this function:

◆ get_table_detail_JSON()

TTableDetails com.mapd.metadata.MetaConnect.get_table_detail_JSON ( String tableName ) throws IOException, RuntimeException

inlineprivate

Definition at line 445 of file MetaConnect.java.

References com.mapd.metadata.MetaConnect.get_physical_cols(), com.mapd.metadata.MetaConnect.is_geometry(), and com.mapd.metadata.MetaConnect.typeToThrift().

Referenced by com.mapd.metadata.MetaConnect.get_table_detail_SQL().

                                                {
     TTableDetails td = new TTableDetails();
     td.getRow_descIterator();
 
     // open table json file
     final String filePath = dataDir + "/mapd_catalogs/" + db + "_temp_tables.json";
     MAPDLOGGER.debug("Opening temp table file at " + filePath);
 
     String tempTablesJsonStr;
     try {
       File tempTablesFile = new File(filePath);
       FileInputStream tempTablesStream = new FileInputStream(tempTablesFile);
       byte[] data = new byte[(int) tempTablesFile.length()];
       tempTablesStream.read(data);
       tempTablesStream.close();
 
       tempTablesJsonStr = new String(data, "UTF-8");
     } catch (java.io.FileNotFoundException e) {
       throw new RuntimeException("Failed to read temporary tables file.");
     }
 
     Gson gson = new Gson();
     JsonObject fileParentObject = gson.fromJson(tempTablesJsonStr, JsonObject.class);
     if (fileParentObject == null) {
       throw new IOException("Malformed temporary tables file.");
     }
 
     JsonObject tableObject = fileParentObject.getAsJsonObject(tableName);
     if (tableObject == null) {
       throw new RuntimeException(
               "Failed to find table " + tableName + " in temporary tables file.");
     }
 
     String jsonTableName = tableObject.get("name").getAsString();
     assert (tableName == jsonTableName);
     int id = tableObject.get("id").getAsInt();
     MAPDLOGGER.debug("table id is " + id);
     MAPDLOGGER.debug("table name is " + tableName);
 
     JsonArray jsonColumns = tableObject.getAsJsonArray("columns");
     assert (jsonColumns != null);
 
     int skip_physical_cols = 0;
     for (JsonElement columnElement : jsonColumns) {
       JsonObject columnObject = columnElement.getAsJsonObject();
 
       String colName = columnObject.get("name").getAsString();
       MAPDLOGGER.debug("name = " + colName);
       int colType = columnObject.get("coltype").getAsInt();
       MAPDLOGGER.debug("coltype = " + colType);
       int colSubType = columnObject.get("colsubtype").getAsInt();
       MAPDLOGGER.debug("colsubtype = " + colSubType);
       int colDim = columnObject.get("coldim").getAsInt();
       MAPDLOGGER.debug("coldim = " + colDim);
       int colScale = columnObject.get("colscale").getAsInt();
       MAPDLOGGER.debug("colscale = " + colScale);
       boolean isNotNull = columnObject.get("is_notnull").getAsBoolean();
       MAPDLOGGER.debug("is_notnull = " + isNotNull);
       boolean isSystemCol = columnObject.get("is_systemcol").getAsBoolean();
       MAPDLOGGER.debug("is_systemcol = " + isSystemCol);
       boolean isVirtualCol = columnObject.get("is_virtualcol").getAsBoolean();
       MAPDLOGGER.debug("is_vitrualcol = " + isVirtualCol);
       boolean isDeletedCol = columnObject.get("is_deletedcol").getAsBoolean();
       MAPDLOGGER.debug("is_deletedcol = " + isDeletedCol);
       MAPDLOGGER.debug("");
 
       if (isDeletedCol) {
         MAPDLOGGER.debug("Skipping delete column.");
         continue;
       }
 
       TColumnType tct = new TColumnType();
       TTypeInfo tti = new TTypeInfo();
       TDatumType tdt;
 
       if (colType == KARRAY) {
         tti.is_array = true;
         tdt = typeToThrift(colSubType);
       } else {
         tti.is_array = false;
         tdt = typeToThrift(colType);
       }
 
       tti.nullable = !isNotNull;
       tti.encoding = TEncodingType.NONE;
       tti.type = tdt;
       tti.scale = colScale;
       tti.precision = colDim;
 
       tct.col_name = colName;
       tct.col_type = tti;
       tct.is_system = isSystemCol;
 
       if (skip_physical_cols <= 0) skip_physical_cols = get_physical_cols(colType);
       if (is_geometry(colType) || skip_physical_cols-- <= 0) td.addToRow_desc(tct);
     }
 
     return td;
   }

Here is the call graph for this function:

Here is the caller graph for this function:

◆ get_table_detail_SQL()

TTableDetails com.mapd.metadata.MetaConnect.get_table_detail_SQL ( String tableName )

inlineprivate

Definition at line 344 of file MetaConnect.java.

References com.mapd.metadata.MetaConnect.get_physical_cols(), com.mapd.metadata.MetaConnect.get_table_detail_JSON(), com.mapd.metadata.MetaConnect.getTableId(), com.mapd.metadata.MetaConnect.getViewSqlViaSql(), com.mapd.metadata.MetaConnect.is_geometry(), com.mapd.metadata.MetaConnect.isView(), and com.mapd.metadata.MetaConnect.typeToThrift().

Referenced by com.mapd.metadata.MetaConnect.get_table_details().

                                                                {
     TTableDetails td = new TTableDetails();
     td.getRow_descIterator();
     int id = getTableId(tableName);
     if (id == -1) {
       try {
         return get_table_detail_JSON(tableName);
       } catch (Exception e) {
         String err = "Table '" + tableName + "' does not exist for DB '" + db + "'";
         MAPDLOGGER.error(err);
         throw new RuntimeException(err);
       }
     }
 
     // read data from table
     Statement stmt = null;
     ResultSet rs = null;
     try {
       stmt = catConn.createStatement();
       MAPDLOGGER.debug("table id is " + id);
       MAPDLOGGER.debug("table name is " + tableName);
       String query = String.format(
               "SELECT * FROM mapd_columns where tableid = %d and not is_deletedcol order by columnid;",
               id);
       MAPDLOGGER.debug(query);
       rs = stmt.executeQuery(query);
       int skip_physical_cols = 0;
       while (rs.next()) {
         String colName = rs.getString("name");
         MAPDLOGGER.debug("name = " + colName);
         int colType = rs.getInt("coltype");
         MAPDLOGGER.debug("coltype = " + colType);
         int colSubType = rs.getInt("colsubtype");
         MAPDLOGGER.debug("colsubtype = " + colSubType);
         int colDim = rs.getInt("coldim");
         MAPDLOGGER.debug("coldim = " + colDim);
         int colScale = rs.getInt("colscale");
         MAPDLOGGER.debug("colscale = " + colScale);
         boolean isNotNull = rs.getBoolean("is_notnull");
         MAPDLOGGER.debug("is_notnull = " + isNotNull);
         boolean isSystemCol = rs.getBoolean("is_systemcol");
         MAPDLOGGER.debug("is_systemcol = " + isSystemCol);
         boolean isVirtualCol = rs.getBoolean("is_virtualcol");
         MAPDLOGGER.debug("is_vitrualcol = " + isVirtualCol);
         MAPDLOGGER.debug("");
         TColumnType tct = new TColumnType();
         TTypeInfo tti = new TTypeInfo();
         TDatumType tdt;
 
         if (colType == KARRAY) {
           tti.is_array = true;
           tdt = typeToThrift(colSubType);
         } else {
           tti.is_array = false;
           tdt = typeToThrift(colType);
         }
 
         tti.nullable = !isNotNull;
         tti.encoding = TEncodingType.NONE;
         tti.type = tdt;
         tti.scale = colScale;
         tti.precision = colDim;
 
         tct.col_name = colName;
         tct.col_type = tti;
         tct.is_system = isSystemCol;
 
         if (skip_physical_cols <= 0) skip_physical_cols = get_physical_cols(colType);
         if (is_geometry(colType) || skip_physical_cols-- <= 0) td.addToRow_desc(tct);
       }
     } catch (Exception e) {
       String err = "error trying to read from mapd_columns, error was " + e.getMessage();
       MAPDLOGGER.error(err);
       throw new RuntimeException(err);
     } finally {
       if (rs != null) {
         try {
           rs.close();
         } catch (SQLException ex) {
           String err = "Could not close resultset, error was " + ex.getMessage();
           MAPDLOGGER.error(err);
           throw new RuntimeException(err);
         }
       }
       if (stmt != null) {
         try {
           stmt.close();
         } catch (SQLException ex) {
           String err = "Could not close stmt, error was " + ex.getMessage();
           MAPDLOGGER.error(err);
           throw new RuntimeException(err);
         }
       }
     }
     if (isView(tableName)) {
       td.setView_sqlIsSet(true);
       td.setView_sql(getViewSqlViaSql(id));
     }
     return td;
   }

Here is the call graph for this function:

Here is the caller graph for this function:

◆ get_table_details()

TTableDetails com.mapd.metadata.MetaConnect.get_table_details ( String tableName )

inline

Definition at line 285 of file MetaConnect.java.

References com.mapd.metadata.MetaConnect.connectToDBCatalog(), com.mapd.metadata.MetaConnect.disconnectFromDBCatalog(), com.mapd.metadata.MetaConnect.get_table_detail_SQL(), com.mapd.calcite.parser.MapDUser.getSession(), and com.mapd.common.SockTransportProperties.openClientTransport().

Referenced by com.mapd.metadata.MetaConnect.getTable().

                                                            {
     if (mapdPort == -1) {
       // use sql
       connectToDBCatalog();
       TTableDetails td = get_table_detail_SQL(tableName);
       disconnectFromDBCatalog();
       return td;
     }
     // use thrift direct to local server
     try {
       TProtocol protocol = null;
 
       TTransport transport =
               sock_transport_properties.openClientTransport("localhost", mapdPort);
       if (!transport.isOpen()) transport.open();
       protocol = new TBinaryProtocol(transport);
 
       OmniSci.Client client = new OmniSci.Client(protocol);
 
       TTableDetails td =
               client.get_internal_table_details(currentUser.getSession(), tableName);
 
       transport.close();
 
       return td;
 
     } catch (TTransportException ex) {
       MAPDLOGGER.error(ex.toString());
       throw new RuntimeException(ex.toString());
     } catch (TOmniSciException ex) {
       MAPDLOGGER.error(ex.toString());
       throw new RuntimeException(ex.toString());
     } catch (TException ex) {
       MAPDLOGGER.error(ex.toString());
       throw new RuntimeException(ex.toString());
     }
   }

Here is the call graph for this function:

Here is the caller graph for this function:

◆ getTable()

Table com.mapd.metadata.MetaConnect.getTable ( String tableName )

inline

Definition at line 154 of file MetaConnect.java.

References com.mapd.metadata.MetaConnect.get_table_details(), and com.mapd.metadata.MetaConnect.getViewSql().

Referenced by com.mapd.calcite.parser.MapDSchema.getTable().

                                           {
     List<String> dbTable = ImmutableList.of(db.toUpperCase(), tableName.toUpperCase());
     Table cTable = MAPD_TABLE_DETAILS.get(dbTable);
     if (cTable != null) {
       return cTable;
     }
 
     TTableDetails td = get_table_details(tableName);
 
     if (td.getView_sql() == null || td.getView_sql().isEmpty()) {
       MAPDLOGGER.debug("Processing a table");
       Table rTable = new MapDTable(td);
       MAPD_TABLE_DETAILS.putIfAbsent(dbTable, rTable);
       return rTable;
     } else {
       MAPDLOGGER.debug("Processing a view");
       Table rTable = new MapDView(getViewSql(tableName), td, parser);
       MAPD_TABLE_DETAILS.putIfAbsent(dbTable, rTable);
       return rTable;
     }
   }

Here is the call graph for this function:

Here is the caller graph for this function:

◆ getTableId()

int com.mapd.metadata.MetaConnect.getTableId ( String tableName )

inlineprivate

Definition at line 546 of file MetaConnect.java.

Referenced by com.mapd.metadata.MetaConnect.get_table_detail_SQL(), and com.mapd.metadata.MetaConnect.getViewSql().

                                            {
     Statement stmt = null;
     ResultSet rs = null;
     int tableId = -1;
     try {
       stmt = catConn.createStatement();
       rs = stmt.executeQuery(String.format(
               "SELECT tableid FROM mapd_tables where name = '%s' COLLATE NOCASE;",
               tableName));
       while (rs.next()) {
         tableId = rs.getInt("tableid");
         MAPDLOGGER.debug("tableId = " + tableId);
         MAPDLOGGER.debug("");
       }
       rs.close();
       stmt.close();
     } catch (Exception e) {
       String err = "Error trying to read from metadata table mapd_tables;DB: " + db
               + " data dir " + dataDir + ", error was " + e.getMessage();
       MAPDLOGGER.error(err);
       throw new RuntimeException(err);
     } finally {
       if (rs != null) {
         try {
           rs.close();
         } catch (SQLException ex) {
           String err = "Could not close resultset, error was " + ex.getMessage();
           MAPDLOGGER.error(err);
           throw new RuntimeException(err);
         }
       }
       if (stmt != null) {
         try {
           stmt.close();
         } catch (SQLException ex) {
           String err = "Could not close stmt, error was " + ex.getMessage();
           MAPDLOGGER.error(err);
           throw new RuntimeException(err);
         }
       }
     }
     return (tableId);
   }

Here is the caller graph for this function:

◆ getTables()

Set<String> com.mapd.metadata.MetaConnect.getTables ( )

inline

Definition at line 176 of file MetaConnect.java.

References com.mapd.metadata.MetaConnect.connectToDBCatalog(), com.mapd.metadata.MetaConnect.disconnectFromDBCatalog(), com.mapd.calcite.parser.MapDUser.getSession(), com.mapd.metadata.MetaConnect.getTables_SQL(), and com.mapd.common.SockTransportProperties.openClientTransport().

Referenced by com.mapd.calcite.parser.MapDSchema.getTableNames().

                                  {
     Set<String> mSet = MAPD_DATABASE_TO_TABLES.get(db.toUpperCase());
     if (mSet != null) {
       return mSet;
     }
 
     if (mapdPort == -1) {
       // use sql
       connectToDBCatalog();
       Set<String> ts = getTables_SQL();
       disconnectFromDBCatalog();
       MAPD_DATABASE_TO_TABLES.putIfAbsent(db.toUpperCase(), ts);
       return ts;
     }
     // use thrift direct to local server
     try {
       TProtocol protocol = null;
       TTransport transport =
               sock_transport_properties.openClientTransport("localhost", mapdPort);
       if (!transport.isOpen()) transport.open();
       protocol = new TBinaryProtocol(transport);
 
       OmniSci.Client client = new OmniSci.Client(protocol);
 
       List<String> tablesList = client.get_tables(currentUser.getSession());
       Set<String> ts = new HashSet<String>(tablesList.size());
       for (String tableName : tablesList) {
         ts.add(tableName);
       }
 
       transport.close();
       MAPD_DATABASE_TO_TABLES.putIfAbsent(db.toUpperCase(), ts);
       return ts;
 
     } catch (TTransportException ex) {
       MAPDLOGGER.error("TTransportException on port [" + mapdPort + "]");
       MAPDLOGGER.error(ex.toString());
       throw new RuntimeException(ex.toString());
     } catch (TOmniSciException ex) {
       MAPDLOGGER.error(ex.toString());
       throw new RuntimeException(ex.toString());
     } catch (TException ex) {
       MAPDLOGGER.error(ex.toString());
       throw new RuntimeException(ex.toString());
     }
   }

Here is the call graph for this function:

Here is the caller graph for this function:

◆ getTables_SQL()

Set<String> com.mapd.metadata.MetaConnect.getTables_SQL ( )

inlineprivate

Definition at line 223 of file MetaConnect.java.

References com.mapd.metadata.MetaConnect.connectToDBCatalog(), and com.mapd.metadata.MetaConnect.disconnectFromDBCatalog().

Referenced by com.mapd.metadata.MetaConnect.getTables().

                                       {
     connectToDBCatalog();
     Set<String> tableSet = new HashSet<String>();
     Statement stmt = null;
     ResultSet rs = null;
     String sqlText = "";
     try {
       stmt = catConn.createStatement();
 
       // get the tables
       rs = stmt.executeQuery("SELECT name FROM mapd_tables ");
       while (rs.next()) {
         tableSet.add(rs.getString("name"));
         /*--*/
         MAPDLOGGER.debug("Object name = " + rs.getString("name"));
       }
       rs.close();
       stmt.close();
 
     } catch (Exception e) {
       String err = "error trying to get all the tables, error was " + e.getMessage();
       MAPDLOGGER.error(err);
       throw new RuntimeException(err);
     }
     disconnectFromDBCatalog();
 
     try {
       // open temp table json file
       final String filePath = dataDir + "/mapd_catalogs/" + db + "_temp_tables.json";
       MAPDLOGGER.debug("Opening temp table file at " + filePath);
       String tempTablesJsonStr;
       try {
         File tempTablesFile = new File(filePath);
         FileInputStream tempTablesStream = new FileInputStream(tempTablesFile);
         byte[] data = new byte[(int) tempTablesFile.length()];
         tempTablesStream.read(data);
         tempTablesStream.close();
 
         tempTablesJsonStr = new String(data, "UTF-8");
       } catch (java.io.FileNotFoundException e) {
         return tableSet;
       }
 
       Gson gson = new Gson();
       JsonObject fileParentObject = gson.fromJson(tempTablesJsonStr, JsonObject.class);
       for (Entry<String, JsonElement> member : fileParentObject.entrySet()) {
         String tableName = member.getKey();
         tableSet.add(tableName);
         /*--*/
         MAPDLOGGER.debug("Temp table object name = " + tableName);
       }
 
     } catch (Exception e) {
       String err = "error trying to load temporary tables from json file, error was "
               + e.getMessage();
       MAPDLOGGER.error(err);
       throw new RuntimeException(err);
     }
 
     return tableSet;
   }

Here is the call graph for this function:

Here is the caller graph for this function:

◆ getViewSql()

String com.mapd.metadata.MetaConnect.getViewSql ( String tableName )

inlineprivate

Definition at line 614 of file MetaConnect.java.

References com.mapd.metadata.MetaConnect.connectToDBCatalog(), com.mapd.metadata.MetaConnect.disconnectFromDBCatalog(), com.mapd.calcite.parser.MapDUser.getSession(), com.mapd.metadata.MetaConnect.getTableId(), com.mapd.metadata.MetaConnect.getViewSqlViaSql(), and com.mapd.common.SockTransportProperties.openClientTransport().

Referenced by com.mapd.metadata.MetaConnect.getTable().

                                               {
     String sqlText;
     if (mapdPort == -1) {
       // use sql
       connectToDBCatalog();
       sqlText = getViewSqlViaSql(getTableId(tableName));
       disconnectFromDBCatalog();
     } else {
       // use thrift direct to local server
       try {
         TProtocol protocol = null;
 
         TTransport transport =
                 sock_transport_properties.openClientTransport("localhost", mapdPort);
         if (!transport.isOpen()) transport.open();
         protocol = new TBinaryProtocol(transport);
 
         OmniSci.Client client = new OmniSci.Client(protocol);
 
         TTableDetails td = client.get_table_details(currentUser.getSession(), tableName);
 
         transport.close();
 
         sqlText = td.getView_sql();
 
       } catch (TTransportException ex) {
         MAPDLOGGER.error(ex.toString());
         throw new RuntimeException(ex.toString());
       } catch (TOmniSciException ex) {
         MAPDLOGGER.error(ex.toString());
         throw new RuntimeException(ex.toString());
       } catch (TException ex) {
         MAPDLOGGER.error(ex.toString());
         throw new RuntimeException(ex.toString());
       }
     }
     /* return string without the sqlite's trailing semicolon */
     if (sqlText.charAt(sqlText.length() - 1) == ';') {
       return (sqlText.substring(0, sqlText.length() - 1));
     } else {
       return (sqlText);
     }
   }

Here is the call graph for this function:

Here is the caller graph for this function:

◆ getViewSqlViaSql()

String com.mapd.metadata.MetaConnect.getViewSqlViaSql ( int tableId )

inlineprivate

Definition at line 659 of file MetaConnect.java.

Referenced by com.mapd.metadata.MetaConnect.get_table_detail_SQL(), and com.mapd.metadata.MetaConnect.getViewSql().

                                                {
     Statement stmt;
     ResultSet rs;
     String sqlText = "";
     try {
       stmt = catConn.createStatement();
       rs = stmt.executeQuery(String.format(
               "SELECT sql FROM mapd_views where tableid = '%s' COLLATE NOCASE;",
               tableId));
       while (rs.next()) {
         sqlText = rs.getString("sql");
         MAPDLOGGER.debug("View definition = " + sqlText);
         MAPDLOGGER.debug("");
       }
       rs.close();
       stmt.close();
     } catch (Exception e) {
       String err = "error trying to read from mapd_views, error was " + e.getMessage();
       MAPDLOGGER.error(err);
       throw new RuntimeException(err);
     }
     if (sqlText == null || sqlText.length() == 0) {
       String err = "No view text found";
       MAPDLOGGER.error(err);
       throw new RuntimeException(err);
     }
     return sqlText;
   }

Here is the caller graph for this function:

◆ is_geometry()

static final boolean com.mapd.metadata.MetaConnect.is_geometry ( int type )

inlinestatic

Definition at line 339 of file MetaConnect.java.

References com.mapd.metadata.MetaConnect.KMULTIPOLYGON.

Referenced by com.mapd.metadata.MetaConnect.get_table_detail_JSON(), and com.mapd.metadata.MetaConnect.get_table_detail_SQL().

                                                     {
     return type == KPOINT || type == KLINESTRING || type == KPOLYGON
             || type == KMULTIPOLYGON;
   }

Here is the caller graph for this function:

◆ isView()

boolean com.mapd.metadata.MetaConnect.isView ( String tableName )

inlineprivate

Definition at line 590 of file MetaConnect.java.

Referenced by com.mapd.metadata.MetaConnect.get_table_detail_SQL().

                                            {
     Statement stmt;
     ResultSet rs;
     int viewFlag = 0;
     try {
       stmt = catConn.createStatement();
       rs = stmt.executeQuery(String.format(
               "SELECT isview FROM mapd_tables where name = '%s' COLLATE NOCASE;",
               tableName));
       while (rs.next()) {
         viewFlag = rs.getInt("isview");
         MAPDLOGGER.debug("viewFlag = " + viewFlag);
         MAPDLOGGER.debug("");
       }
       rs.close();
       stmt.close();
     } catch (Exception e) {
       String err = "error trying to read from mapd_views, error was " + e.getMessage();
       MAPDLOGGER.error(err);
       throw new RuntimeException(err);
     }
     return (viewFlag == 1);
   }

Here is the caller graph for this function:

◆ typeToThrift()

TDatumType com.mapd.metadata.MetaConnect.typeToThrift ( int type )

inlineprivate

Definition at line 688 of file MetaConnect.java.

Referenced by com.mapd.metadata.MetaConnect.get_table_detail_JSON(), and com.mapd.metadata.MetaConnect.get_table_detail_SQL().

                                             {
     switch (type) {
       case KBOOLEAN:
         return TDatumType.BOOL;
       case KTINYINT:
         return TDatumType.TINYINT;
       case KSMALLINT:
         return TDatumType.SMALLINT;
       case KINT:
         return TDatumType.INT;
       case KBIGINT:
         return TDatumType.BIGINT;
       case KFLOAT:
         return TDatumType.FLOAT;
       case KNUMERIC:
       case KDECIMAL:
         return TDatumType.DECIMAL;
       case KDOUBLE:
         return TDatumType.DOUBLE;
       case KTEXT:
       case KVARCHAR:
       case KCHAR:
         return TDatumType.STR;
       case KTIME:
         return TDatumType.TIME;
       case KTIMESTAMP:
         return TDatumType.TIMESTAMP;
       case KDATE:
         return TDatumType.DATE;
       case KINTERVAL_DAY_TIME:
         return TDatumType.INTERVAL_DAY_TIME;
       case KINTERVAL_YEAR_MONTH:
         return TDatumType.INTERVAL_YEAR_MONTH;
       case KPOINT:
         return TDatumType.POINT;
       case KLINESTRING:
         return TDatumType.LINESTRING;
       case KPOLYGON:
         return TDatumType.POLYGON;
       case KMULTIPOLYGON:
         return TDatumType.MULTIPOLYGON;
       default:
         return null;
     }
   }

Here is the caller graph for this function:

◆ updateMetaData()

void com.mapd.metadata.MetaConnect.updateMetaData	(	String	schema,
		String	table
	)

inline

Definition at line 734 of file MetaConnect.java.

References all.

Referenced by com.mapd.calcite.parser.MapDSchema.updateMetaData().

                                                           {
     // Check if table is specified, if not we are dropping an entire DB so need to
     // remove all
     // tables for that DB
     if (table.equals("")) {
       // Drop db and all tables
       // iterate through all and remove matching schema
       Set<List<String>> all = new HashSet<>(MAPD_TABLE_DETAILS.keySet());
       for (List<String> keys : all) {
         if (keys.get(0).equals(schema.toUpperCase())) {
           MAPDLOGGER.debug("removing schema " + keys.get(0) + " table " + keys.get(1));
           MAPD_TABLE_DETAILS.remove(keys);
         }
       }
     } else {
       MAPDLOGGER.debug("removing schema " + schema.toUpperCase() + " table "
               + table.toUpperCase());
       MAPD_TABLE_DETAILS.remove(
               ImmutableList.of(schema.toUpperCase(), table.toUpperCase()));
     }
     // Invalidate views
     Set<List<String>> all = new HashSet<>(MAPD_TABLE_DETAILS.keySet());
     for (List<String> keys : all) {
       if (keys.get(0).equals(schema.toUpperCase())) {
         Table ttable = MAPD_TABLE_DETAILS.get(keys);
         if (ttable instanceof MapDView) {
           MAPDLOGGER.debug(
                   "removing view in schema " + keys.get(0) + " view " + keys.get(1));
           MAPD_TABLE_DETAILS.remove(keys);
         }
       }
     }
     // now remove schema
     MAPDLOGGER.debug("removing schema " + schema.toUpperCase());
     MAPD_DATABASE_TO_TABLES.remove(schema.toUpperCase());
   }

Here is the caller graph for this function:

Member Data Documentation

◆ catConn

Connection com.mapd.metadata.MetaConnect.catConn

private

Definition at line 72 of file MetaConnect.java.

◆ currentUser

final MapDUser com.mapd.metadata.MetaConnect.currentUser

private

Definition at line 70 of file MetaConnect.java.

◆ dataDir

final String com.mapd.metadata.MetaConnect.dataDir

private

Definition at line 68 of file MetaConnect.java.

Referenced by com.mapd.metadata.MetaConnect.MetaConnect().

◆ db

final String com.mapd.metadata.MetaConnect.db

private

Definition at line 69 of file MetaConnect.java.

Referenced by com.mapd.metadata.MetaConnect.connectToDBCatalog().

◆ KARRAY

final int com.mapd.metadata.MetaConnect.KARRAY = 15

staticprivate

Definition at line 89 of file MetaConnect.java.

◆ KBIGINT

final int com.mapd.metadata.MetaConnect.KBIGINT = 12

staticprivate

Definition at line 86 of file MetaConnect.java.

Referenced by com.mapd.metadata.MetaConnect.typeToThrift().

◆ KBOOLEAN

final int com.mapd.metadata.MetaConnect.KBOOLEAN = 1

staticprivate

Definition at line 75 of file MetaConnect.java.

Referenced by com.mapd.metadata.MetaConnect.typeToThrift().

◆ KCHAR

final int com.mapd.metadata.MetaConnect.KCHAR = 2

staticprivate

Definition at line 76 of file MetaConnect.java.

Referenced by com.mapd.metadata.MetaConnect.typeToThrift().

◆ KDATE

final int com.mapd.metadata.MetaConnect.KDATE = 14

staticprivate

Definition at line 88 of file MetaConnect.java.

Referenced by com.mapd.metadata.MetaConnect.typeToThrift().

◆ KDECIMAL

final int com.mapd.metadata.MetaConnect.KDECIMAL = 5

staticprivate

Definition at line 79 of file MetaConnect.java.

Referenced by com.mapd.metadata.MetaConnect.typeToThrift().

◆ KDOUBLE

final int com.mapd.metadata.MetaConnect.KDOUBLE = 9

staticprivate

Definition at line 83 of file MetaConnect.java.

Referenced by com.mapd.metadata.MetaConnect.typeToThrift().

◆ KFLOAT

final int com.mapd.metadata.MetaConnect.KFLOAT = 8

staticprivate

Definition at line 82 of file MetaConnect.java.

Referenced by com.mapd.metadata.MetaConnect.typeToThrift().

◆ KINT

final int com.mapd.metadata.MetaConnect.KINT = 6

staticprivate

Definition at line 80 of file MetaConnect.java.

Referenced by com.mapd.metadata.MetaConnect.typeToThrift().

◆ KINTERVAL_DAY_TIME

final int com.mapd.metadata.MetaConnect.KINTERVAL_DAY_TIME = 16

staticprivate

Definition at line 90 of file MetaConnect.java.

Referenced by com.mapd.metadata.MetaConnect.typeToThrift().

◆ KINTERVAL_YEAR_MONTH

final int com.mapd.metadata.MetaConnect.KINTERVAL_YEAR_MONTH = 17

staticprivate

Definition at line 91 of file MetaConnect.java.

Referenced by com.mapd.metadata.MetaConnect.typeToThrift().

◆ KLINESTRING

final int com.mapd.metadata.MetaConnect.KLINESTRING = 19

staticprivate

Definition at line 93 of file MetaConnect.java.

Referenced by com.mapd.metadata.MetaConnect.get_physical_cols(), and com.mapd.metadata.MetaConnect.typeToThrift().

◆ KMULTIPOLYGON

final int com.mapd.metadata.MetaConnect.KMULTIPOLYGON = 21

staticprivate

Definition at line 95 of file MetaConnect.java.

Referenced by com.mapd.metadata.MetaConnect.get_physical_cols(), com.mapd.metadata.MetaConnect.is_geometry(), and com.mapd.metadata.MetaConnect.typeToThrift().

◆ KNUMERIC

final int com.mapd.metadata.MetaConnect.KNUMERIC = 4

staticprivate

Definition at line 78 of file MetaConnect.java.

Referenced by com.mapd.metadata.MetaConnect.typeToThrift().

◆ KPOINT

final int com.mapd.metadata.MetaConnect.KPOINT = 18

staticprivate

Definition at line 92 of file MetaConnect.java.

Referenced by com.mapd.metadata.MetaConnect.get_physical_cols(), and com.mapd.metadata.MetaConnect.typeToThrift().

◆ KPOLYGON

final int com.mapd.metadata.MetaConnect.KPOLYGON = 20

staticprivate

Definition at line 94 of file MetaConnect.java.

Referenced by com.mapd.metadata.MetaConnect.get_physical_cols(), and com.mapd.metadata.MetaConnect.typeToThrift().

◆ KSMALLINT

final int com.mapd.metadata.MetaConnect.KSMALLINT = 7

staticprivate

Definition at line 81 of file MetaConnect.java.

Referenced by com.mapd.metadata.MetaConnect.typeToThrift().

◆ KTEXT

final int com.mapd.metadata.MetaConnect.KTEXT = 13

staticprivate

Definition at line 87 of file MetaConnect.java.

Referenced by com.mapd.metadata.MetaConnect.typeToThrift().

◆ KTIME

final int com.mapd.metadata.MetaConnect.KTIME = 10

staticprivate

Definition at line 84 of file MetaConnect.java.

Referenced by com.mapd.metadata.MetaConnect.typeToThrift().

◆ KTIMESTAMP

final int com.mapd.metadata.MetaConnect.KTIMESTAMP = 11

staticprivate

Definition at line 85 of file MetaConnect.java.

Referenced by com.mapd.metadata.MetaConnect.typeToThrift().

◆ KTINYINT

final int com.mapd.metadata.MetaConnect.KTINYINT = 22

staticprivate

Definition at line 96 of file MetaConnect.java.

Referenced by com.mapd.metadata.MetaConnect.typeToThrift().

◆ KVARCHAR

final int com.mapd.metadata.MetaConnect.KVARCHAR = 3

staticprivate

Definition at line 77 of file MetaConnect.java.

Referenced by com.mapd.metadata.MetaConnect.typeToThrift().

◆ MAPD_DATABASE_TO_TABLES

volatile Map<String, Set<String> > com.mapd.metadata.MetaConnect.MAPD_DATABASE_TO_TABLES

staticprivate

Initial value:

=

new ConcurrentHashMap<>()

Definition at line 98 of file MetaConnect.java.

◆ MAPD_TABLE_DETAILS

volatile Map<List<String>, Table> com.mapd.metadata.MetaConnect.MAPD_TABLE_DETAILS

staticprivate

Initial value:

=

new ConcurrentHashMap<>()

Definition at line 100 of file MetaConnect.java.

◆ MAPDLOGGER

final Logger com.mapd.metadata.MetaConnect.MAPDLOGGER = LoggerFactory.getLogger(MetaConnect.class)

staticpackage

Definition at line 67 of file MetaConnect.java.

◆ mapdPort

final int com.mapd.metadata.MetaConnect.mapdPort

private

Definition at line 71 of file MetaConnect.java.

Referenced by com.mapd.metadata.MetaConnect.MetaConnect().

◆ parser

final MapDParser com.mapd.metadata.MetaConnect.parser

private

Definition at line 73 of file MetaConnect.java.

Referenced by com.mapd.metadata.MetaConnect.MetaConnect().

◆ sock_transport_properties

final SockTransportProperties com.mapd.metadata.MetaConnect.sock_transport_properties

private

Definition at line 102 of file MetaConnect.java.

The documentation for this class was generated from the following file:

/home/jenkins-slave/workspace/core-os-doxygen/java/calcite/src/main/java/com/mapd/metadata/MetaConnect.java

Public Member Functions

Static Public Member Functions

Static Package Attributes

Private Member Functions

Private Attributes

Static Private Attributes

Detailed Description

Constructor & Destructor Documentation

◆ MetaConnect()

Member Function Documentation

◆ connectToDBCatalog()

◆ disconnectFromDBCatalog()

◆ get_physical_cols()

◆ get_table_detail_JSON()

◆ get_table_detail_SQL()

◆ get_table_details()

◆ getTable()

◆ getTableId()

◆ getTables()

◆ getTables_SQL()

◆ getViewSql()

◆ getViewSqlViaSql()

◆ is_geometry()

◆ isView()

◆ typeToThrift()

◆ updateMetaData()

Member Data Documentation

◆ catConn

◆ currentUser

◆ dataDir

◆ db

◆ KARRAY

◆ KBIGINT

◆ KBOOLEAN

◆ KCHAR

◆ KDATE

◆ KDECIMAL

◆ KDOUBLE

◆ KFLOAT

◆ KINT

◆ KINTERVAL_DAY_TIME

◆ KINTERVAL_YEAR_MONTH

◆ KLINESTRING

◆ KMULTIPOLYGON

◆ KNUMERIC

◆ KPOINT

◆ KPOLYGON

◆ KSMALLINT

◆ KTEXT

◆ KTIME

◆ KTIMESTAMP

◆ KTINYINT

◆ KVARCHAR

◆ MAPD_DATABASE_TO_TABLES

◆ MAPD_TABLE_DETAILS

◆ MAPDLOGGER

◆ mapdPort

◆ parser

◆ sock_transport_properties