com.mapd.parser.server.ExtensionFunctionSignatureParser Class Reference

Collaboration diagram for com.mapd.parser.server.ExtensionFunctionSignatureParser:

Static Package Functions
static Map< String, ExtensionFunction >	parse (final String file_path) throws IOException
static Map< String, ExtensionFunction >	parseUdfAst (final String file_path) throws IOException
static Map< String, ExtensionFunction >	parseFromString (final String udf_string) throws IOException
static Map< String, ExtensionFunction >	parseFromString (final String udf_string, final boolean is_row_func) throws IOException
static String	signaturesToJson (final Map< String, ExtensionFunction > sigs)
static String	join (final List< String > strs, final String sep)

Static Package Attributes
static final Logger	MAPDLOGGER

Static Private Member Functions
static ExtensionFunction	toSignature (final String ret, final String cs_param_list, final boolean has_variable_name)
static ExtensionFunction	toSignature (final String ret, final String cs_param_list, final boolean has_variable_name, final boolean is_row_func)
static ExtensionFunction.ExtArgumentType	deserializeType (final String type_name)
static ExtensionFunction.ExtArgumentType	pointerType (final ExtensionFunction.ExtArgumentType targetType)

Detailed Description

Author

alex

Definition at line 37 of file ExtensionFunctionSignatureParser.java.

Member Function Documentation

deserializeType()

static ExtensionFunction.ExtArgumentType com.mapd.parser.server.ExtensionFunctionSignatureParser.deserializeType ( final String  type_name )

inlinestaticprivate

Definition at line 154 of file ExtensionFunctionSignatureParser.java.

References com.mapd.parser.server.ExtensionFunction.ExtArgumentType.ArrayBool, com.mapd.parser.server.ExtensionFunction.ExtArgumentType.ArrayDouble, com.mapd.parser.server.ExtensionFunction.ExtArgumentType.ArrayFloat, com.mapd.parser.server.ExtensionFunction.ExtArgumentType.ArrayInt16, com.mapd.parser.server.ExtensionFunction.ExtArgumentType.ArrayInt32, com.mapd.parser.server.ExtensionFunction.ExtArgumentType.ArrayInt64, com.mapd.parser.server.ExtensionFunction.ExtArgumentType.ArrayInt8, com.mapd.parser.server.ExtensionFunction.ExtArgumentType.Bool, com.mapd.parser.server.ExtensionFunction.ExtArgumentType.ColumnDouble, com.mapd.parser.server.ExtensionFunction.ExtArgumentType.ColumnFloat, com.mapd.parser.server.ExtensionFunction.ExtArgumentType.ColumnInt16, com.mapd.parser.server.ExtensionFunction.ExtArgumentType.ColumnInt32, com.mapd.parser.server.ExtensionFunction.ExtArgumentType.ColumnInt64, com.mapd.parser.server.ExtensionFunction.ExtArgumentType.ColumnInt8, com.mapd.parser.server.ExtensionFunction.ExtArgumentType.Cursor, com.mapd.parser.server.ExtensionFunction.ExtArgumentType.Double, com.mapd.parser.server.ExtensionFunction.ExtArgumentType.Float, com.mapd.parser.server.ExtensionFunction.ExtArgumentType.GeoLineString, com.mapd.parser.server.ExtensionFunction.ExtArgumentType.GeoMultiPolygon, com.mapd.parser.server.ExtensionFunction.ExtArgumentType.GeoPoint, com.mapd.parser.server.ExtensionFunction.ExtArgumentType.GeoPolygon, com.mapd.parser.server.ExtensionFunction.ExtArgumentType.Int16, com.mapd.parser.server.ExtensionFunction.ExtArgumentType.Int32, com.mapd.parser.server.ExtensionFunction.ExtArgumentType.Int64, com.mapd.parser.server.ExtensionFunction.ExtArgumentType.Int8, com.mapd.parser.server.ExtensionFunctionSignatureParser.pointerType(), and com.mapd.parser.server.ExtensionFunction.ExtArgumentType.Void.

Referenced by com.mapd.parser.server.ExtensionFunctionSignatureParser.toSignature().

                                  {
    final String const_prefix = "const ";
    final String std_namespace_prefix = "std::";

    if (type_name.startsWith(const_prefix)) {
      return deserializeType(type_name.substring(const_prefix.length()));
    }
    if (type_name.startsWith(std_namespace_prefix)) {
      return deserializeType(type_name.substring(std_namespace_prefix.length()));
    }

    if (type_name.equals("bool") || type_name.equals("_Bool")) {
      return ExtensionFunction.ExtArgumentType.Bool;
    }
    if (type_name.equals("int8_t") || type_name.equals("char")
            || type_name.equals("int8")) {
      return ExtensionFunction.ExtArgumentType.Int8;
    }
    if (type_name.equals("int16_t") || type_name.equals("short")
            || type_name.equals("int16")) {
      return ExtensionFunction.ExtArgumentType.Int16;
    }
    if (type_name.equals("int32_t") || type_name.equals("int")
            || type_name.equals("int32")) {
      return ExtensionFunction.ExtArgumentType.Int32;
    }
    if (type_name.equals("int64_t") || type_name.equals("size_t")
            || type_name.equals("int64") || type_name.equals("long")) {
      return ExtensionFunction.ExtArgumentType.Int64;
    }
    if (type_name.equals("float") || type_name.equals("float32")) {
      return ExtensionFunction.ExtArgumentType.Float;
    }
    if (type_name.equals("double") || type_name.equals("float64")) {
      return ExtensionFunction.ExtArgumentType.Double;
    }
    if (type_name.isEmpty() || type_name.equals("void")) {
      return ExtensionFunction.ExtArgumentType.Void;
    }
    if (type_name.endsWith(" *")) {
      return pointerType(deserializeType(type_name.substring(0, type_name.length() - 2)));
    }
    if (type_name.endsWith("*")) {
      return pointerType(deserializeType(type_name.substring(0, type_name.length() - 1)));
    }
    if (type_name.equals("Array<bool>")) {
      return ExtensionFunction.ExtArgumentType.ArrayBool;
    }
    if (type_name.equals("Array<int8_t>") || type_name.equals("Array<char>")) {
      return ExtensionFunction.ExtArgumentType.ArrayInt8;
    }
    if (type_name.equals("Array<int16_t>") || type_name.equals("Array<short>")) {
      return ExtensionFunction.ExtArgumentType.ArrayInt16;
    }
    if (type_name.equals("Array<int32_t>") || type_name.equals("Array<int>")) {
      return ExtensionFunction.ExtArgumentType.ArrayInt32;
    }
    if (type_name.equals("Array<int64_t>") || type_name.equals("Array<size_t>")
            || type_name.equals("Array<long>")) {
      return ExtensionFunction.ExtArgumentType.ArrayInt64;
    }
    if (type_name.equals("Array<float>")) {
      return ExtensionFunction.ExtArgumentType.ArrayFloat;
    }
    if (type_name.equals("Array<double>")) {
      return ExtensionFunction.ExtArgumentType.ArrayDouble;
    }
    if (type_name.equals("Array<bool>")) {
      return ExtensionFunction.ExtArgumentType.ArrayBool;
    }
    if (type_name.equals("Column<int8_t>") || type_name.equals("Column<char>")) {
      return ExtensionFunction.ExtArgumentType.ColumnInt8;
    }
    if (type_name.equals("Column<int16_t>") || type_name.equals("Column<short>")) {
      return ExtensionFunction.ExtArgumentType.ColumnInt16;
    }
    if (type_name.equals("Column<int32_t>") || type_name.equals("Column<int>")) {
      return ExtensionFunction.ExtArgumentType.ColumnInt32;
    }
    if (type_name.equals("Column<int64_t>") || type_name.equals("Column<size_t>")
            || type_name.equals("Column<long>")) {
      return ExtensionFunction.ExtArgumentType.ColumnInt64;
    }
    if (type_name.equals("Column<float>")) {
      return ExtensionFunction.ExtArgumentType.ColumnFloat;
    }
    if (type_name.equals("Column<double>")) {
      return ExtensionFunction.ExtArgumentType.ColumnDouble;
    }
    if (type_name.equals("Cursor")) {
      return ExtensionFunction.ExtArgumentType.Cursor;
    }
    if (type_name.equals("GeoPoint")) {
      return ExtensionFunction.ExtArgumentType.GeoPoint;
    }
    if (type_name.equals("GeoLineString")) {
      return ExtensionFunction.ExtArgumentType.GeoLineString;
    }
    if (type_name.equals("GeoPolygon")) {
      return ExtensionFunction.ExtArgumentType.GeoPolygon;
    }
    if (type_name.equals("GeoMultiPolygon")) {
      return ExtensionFunction.ExtArgumentType.GeoMultiPolygon;
    }

    MAPDLOGGER.info(
            "ExtensionfunctionSignatureParser::deserializeType: unknown type_name=`"
            + type_name + "`");
    // TODO: Return void for convenience. Consider sanitizing functions for supported
    // types before they reach Calcite
    return ExtensionFunction.ExtArgumentType.Void;
  }

Here is the call graph for this function:

Here is the caller graph for this function:

join()

static String com.mapd.parser.server.ExtensionFunctionSignatureParser.join ( final List< String >  strs, final String  sep  )

inlinestaticpackage

Definition at line 291 of file ExtensionFunctionSignatureParser.java.

Referenced by com.mapd.parser.server.ExtensionFunctionSignatureParser.signaturesToJson(), and com.mapd.parser.server.ExtensionFunction.toJson().

                                                                {
    StringBuilder sb = new StringBuilder();
    if (strs.isEmpty()) {
      return "";
    }
    sb.append(strs.get(0));
    for (int i = 1; i < strs.size(); ++i) {
      sb.append(sep).append(strs.get(i));
    }
    return sb.toString();
  }

Here is the caller graph for this function:

parse()

static Map<String, ExtensionFunction> com.mapd.parser.server.ExtensionFunctionSignatureParser.parse ( final String  file_path ) throws IOException

inlinestaticpackage

Definition at line 41 of file ExtensionFunctionSignatureParser.java.

References parse_ast.line, setup.name, and com.mapd.parser.server.ExtensionFunctionSignatureParser.toSignature().

Referenced by com.mapd.parser.server.CalciteServerHandler.CalciteServerHandler().

                                                                                         {
    File file = new File(file_path);
    FileReader fileReader = new FileReader(file);
    BufferedReader bufferedReader = new BufferedReader(fileReader);
    String line;
    Pattern s = Pattern.compile("\\| ([\\` ]|used)+ ([\\w]+) '([\\w<>]+) \\((.*)\\)'");
    Map<String, ExtensionFunction> sigs = new HashMap<String, ExtensionFunction>();
    while ((line = bufferedReader.readLine()) != null) {
      Matcher m = s.matcher(line);
      if (m.find()) {
        final String name = m.group(2);
        final String ret = m.group(3);
        final String cs_param_list = m.group(4);
        sigs.put(name, toSignature(ret, cs_param_list, false));
      }
    }
    return sigs;
  }

Here is the call graph for this function:

Here is the caller graph for this function:

parseFromString() [1/2]

static Map<String, ExtensionFunction> com.mapd.parser.server.ExtensionFunctionSignatureParser.parseFromString ( final String  udf_string ) throws IOException

inlinestaticpackage

Definition at line 83 of file ExtensionFunctionSignatureParser.java.

                             {
    return parseFromString(udf_string, true);
  }

parseFromString() [2/2]

static Map<String, ExtensionFunction> com.mapd.parser.server.ExtensionFunctionSignatureParser.parseFromString ( final String  udf_string, final boolean  is_row_func  ) throws IOException

inlinestaticpackage

Definition at line 88 of file ExtensionFunctionSignatureParser.java.

References parse_ast.line, setup.name, and com.mapd.parser.server.ExtensionFunctionSignatureParser.toSignature().

                                                                                 {
    StringReader stringReader = new StringReader(udf_string);
    BufferedReader bufferedReader = new BufferedReader(stringReader);
    String line;
    Pattern r = Pattern.compile("([\\w]+)\\s+'([\\w]+)\\s*\\((.*)\\)'");
    Map<String, ExtensionFunction> sigs = new HashMap<String, ExtensionFunction>();
    while ((line = bufferedReader.readLine()) != null) {
      Matcher m = r.matcher(line);
      if (m.find()) {
        final String name = m.group(1);
        final String ret = m.group(2);
        final String cs_param_list = m.group(3);
        sigs.put(name, toSignature(ret, cs_param_list, is_row_func));
      }
    }
    return sigs;
  }

Here is the call graph for this function:

parseUdfAst()

static Map<String, ExtensionFunction> com.mapd.parser.server.ExtensionFunctionSignatureParser.parseUdfAst ( final String  file_path ) throws IOException

inlinestaticpackage

Definition at line 60 of file ExtensionFunctionSignatureParser.java.

References parse_ast.line, setup.name, and com.mapd.parser.server.ExtensionFunctionSignatureParser.toSignature().

Referenced by com.mapd.parser.server.CalciteServerHandler.CalciteServerHandler().

                             {
    File file = new File(file_path);
    FileReader fileReader = new FileReader(file);
    BufferedReader bufferedReader = new BufferedReader(fileReader);
    String line;
    Pattern s = Pattern.compile("([<>:\\w]+) ([:\\w]+)(?:\\(\\))?\\((.*)\\)");
    Map<String, ExtensionFunction> sigs = new HashMap<String, ExtensionFunction>();
    while ((line = bufferedReader.readLine()) != null) {
      Matcher m = s.matcher(line);
      if (m.find()) {
        final String name = m.group(2);
        final String ret = m.group(1);
        final String cs_param_list = m.group(3);
        if (cs_param_list.isEmpty()) {
          continue;
        }
        sigs.put(name, toSignature(ret, cs_param_list, true));
      }
    }
    return sigs;
  }

Here is the call graph for this function:

Here is the caller graph for this function:

pointerType()

static ExtensionFunction.ExtArgumentType com.mapd.parser.server.ExtensionFunctionSignatureParser.pointerType ( final ExtensionFunction.ExtArgumentType  targetType )

inlinestaticprivate

Definition at line 268 of file ExtensionFunctionSignatureParser.java.

References Bool, Double, Int16, Int32, Int64, Int8, com.mapd.parser.server.ExtensionFunction.ExtArgumentType.PBool, com.mapd.parser.server.ExtensionFunction.ExtArgumentType.PDouble, com.mapd.parser.server.ExtensionFunction.ExtArgumentType.PFloat, com.mapd.parser.server.ExtensionFunction.ExtArgumentType.PInt16, com.mapd.parser.server.ExtensionFunction.ExtArgumentType.PInt32, com.mapd.parser.server.ExtensionFunction.ExtArgumentType.PInt64, and com.mapd.parser.server.ExtensionFunction.ExtArgumentType.PInt8.

Referenced by com.mapd.parser.server.ExtensionFunctionSignatureParser.deserializeType().

                                                              {
    switch (targetType) {
      case Bool:
        return ExtensionFunction.ExtArgumentType.PBool;
      case Int8:
        return ExtensionFunction.ExtArgumentType.PInt8;
      case Int16:
        return ExtensionFunction.ExtArgumentType.PInt16;
      case Int32:
        return ExtensionFunction.ExtArgumentType.PInt32;
      case Int64:
        return ExtensionFunction.ExtArgumentType.PInt64;
      case Float:
        return ExtensionFunction.ExtArgumentType.PFloat;
      case Double:
        return ExtensionFunction.ExtArgumentType.PDouble;
      default:
        assert false;
        return null;
    }
  }

Here is the caller graph for this function:

signaturesToJson()

static String com.mapd.parser.server.ExtensionFunctionSignatureParser.signaturesToJson ( final Map< String, ExtensionFunction >  sigs )

inlinestaticpackage

Definition at line 106 of file ExtensionFunctionSignatureParser.java.

References com.mapd.parser.server.ExtensionFunctionSignatureParser.join().

Referenced by com.mapd.parser.server.CalciteServerHandler.CalciteServerHandler(), and com.mapd.parser.server.CalciteServerHandler.setRuntimeExtensionFunctions().

                                                                            {
    List<String> json_sigs = new ArrayList<String>();
    if (sigs != null) {
      for (Map.Entry<String, ExtensionFunction> sig : sigs.entrySet()) {
        if (sig.getValue().isRowUdf()) {
          json_sigs.add(sig.getValue().toJson(sig.getKey()));
        }
      }
    }
    return "[" + join(json_sigs, ",") + "]";
  }

Here is the call graph for this function:

Here is the caller graph for this function:

toSignature() [1/2]

static ExtensionFunction com.mapd.parser.server.ExtensionFunctionSignatureParser.toSignature ( final String  ret, final String  cs_param_list, final boolean  has_variable_name  )

inlinestaticprivate

Definition at line 118 of file ExtensionFunctionSignatureParser.java.

Referenced by com.mapd.parser.server.ExtensionFunctionSignatureParser.parse(), com.mapd.parser.server.ExtensionFunctionSignatureParser.parseFromString(), and com.mapd.parser.server.ExtensionFunctionSignatureParser.parseUdfAst().

                                                                                         {
    return toSignature(ret, cs_param_list, has_variable_name, true);
  }

Here is the caller graph for this function:

toSignature() [2/2]

static ExtensionFunction com.mapd.parser.server.ExtensionFunctionSignatureParser.toSignature ( final String  ret, final String  cs_param_list, final boolean  has_variable_name, final boolean  is_row_func  )

inlinestaticprivate

Definition at line 123 of file ExtensionFunctionSignatureParser.java.

References run_benchmark_import.args, com.mapd.parser.server.ExtensionFunctionSignatureParser.deserializeType(), and com.mapd.parser.server.ExtensionFunction.ExtArgumentType.Void.

                                     {
    String[] params = cs_param_list.split(",");
    List<ExtensionFunction.ExtArgumentType> args =
            new ArrayList<ExtensionFunction.ExtArgumentType>();
    for (final String param : params) {
      ExtensionFunction.ExtArgumentType arg_type;
      if (has_variable_name) {
        String[] full_param = param.trim().split("\\s+");
        if (full_param.length > 0) {
          if (full_param[0].trim().compareTo("const") == 0) {
            assert full_param.length > 1;
            arg_type = deserializeType((full_param[1]).trim());
          } else {
            arg_type = deserializeType((full_param[0]).trim());
          }
        } else {
          arg_type = deserializeType(full_param[0]);
        }
      } else {
        arg_type = deserializeType(param.trim());
      }
      if (arg_type != ExtensionFunction.ExtArgumentType.Void) {
        args.add(arg_type);
      }
    }
    assert is_row_func;
    return new ExtensionFunction(args, deserializeType(ret));
  }

Here is the call graph for this function:

Member Data Documentation

MAPDLOGGER

final Logger com.mapd.parser.server.ExtensionFunctionSignatureParser.MAPDLOGGER

staticpackage

Initial value:

=
          LoggerFactory.getLogger(ExtensionFunctionSignatureParser.class)

Definition at line 38 of file ExtensionFunctionSignatureParser.java.

---

The documentation for this class was generated from the following file:

• /home/jenkins-slave/workspace/core-os-doxygen/java/calcite/src/main/java/com/mapd/parser/server/ExtensionFunctionSignatureParser.java