OmniSciDB
c1a53651b2
|
Classes | |
class | Declaration |
class | Bracket |
class | TokenizeException |
class | ParserException |
class | TransformerException |
class | Token |
class | Tokenize |
class | AstVisitor |
class | AstTransformer |
class | AstPrinter |
class | AstDebugger |
class | TemplateTransformer |
class | FixRowMultiplierPosArgTransformer |
class | RenameNodesTransformer |
class | TextEncodingDictTransformer |
class | FieldAnnotationTransformer |
class | SupportedAnnotationsTransformer |
class | RangeAnnotationTransformer |
class | DeclBracketTransformer |
class | Node |
class | IterableNode |
class | UdtfNode |
class | ArgNode |
class | TypeNode |
class | PrimitiveNode |
class | ComposedNode |
class | AnnotationNode |
class | TemplateNode |
class | Pipeline |
class | Parser |
Functions | |
def | tostring |
def | find_comma |
def | line_is_incomplete |
def | is_identifier_cursor |
def | product_dict |
def | find_signatures |
def | format_function_args |
def | build_template_function_call |
def | build_preflight_function |
def | must_emit_preflight_function |
def | format_annotations |
def | is_template_function |
def | uses_manager |
def | is_cpu_function |
def | is_gpu_function |
def | parse_annotations |
def | add_method |
def | add_methods |
def | call_methods |
Variables | |
string | separator = '$=>$' |
tuple | Signature = namedtuple('Signature', ['name', 'inputs', 'outputs', 'input_annotations', 'output_annotations', 'function_annotations', 'sizer']) |
string | OutputBufferSizeTypes |
string | SupportedAnnotations |
string | SupportedFunctionAnnotations |
tuple | translate_map |
list | input_files = [os.path.join(os.path.dirname(__file__), 'test_udtf_signatures.hpp')] |
tuple | cpu_output_header = os.path.splitext(output_filename) |
tuple | gpu_output_header = os.path.splitext(output_filename) |
list | canonical_input_files = [input_file[input_file.find("/QueryEngine/") + 1:] for input_file in input_files] |
list | header_includes = ['#include "' + canonical_input_file + '"' for canonical_input_file in canonical_input_files] |
int | ADD_FUNC_CHUNK_SIZE = 100 |
string | content |
string | header_content |
tuple | dirname = os.path.dirname(output_filename) |
tuple | f = open(output_filename, 'w') |
Given a list of input files, scan for lines containing UDTF specification statements in the following form: UDTF: function_name(<arguments>) -> <output column types> (, <template type specifications>)? where <arguments> is a comma-separated list of argument types. The argument types specifications are: - scalar types: Int8, Int16, Int32, Int64, Float, Double, Bool, TextEncodingDict, etc - column types: ColumnInt8, ColumnInt16, ColumnInt32, ColumnInt64, ColumnFloat, ColumnDouble, ColumnBool, etc - column list types: ColumnListInt8, ColumnListInt16, ColumnListInt32, ColumnListInt64, ColumnListFloat, ColumnListDouble, ColumnListBool, etc - cursor type: Cursor<t0, t1, ...> where t0, t1 are column or column list types - output buffer size parameter type: RowMultiplier<i>, ConstantParameter<i>, Constant<i>, TableFunctionSpecifiedParameter<i> where i is a literal integer. The output column types is a comma-separated list of column types, see above. In addition, the following equivalents are suppored: Column<T> == ColumnT ColumnList<T> == ColumnListT Cursor<T, V, ...> == Cursor<ColumnT, ColumnV, ...> int8 == int8_t == Int8, etc float == Float, double == Double, bool == Bool T == ColumnT for output column types RowMultiplier == RowMultiplier<i> where i is the one-based position of the sizer argument when no sizer argument is provided, Constant<1> is assumed Argument types can be annotated using `|' (bar) symbol after an argument type specification. An annotation is specified by a label and a value separated by `=' (equal) symbol. Multiple annotations can be specified by using `|` (bar) symbol as the annotations separator. Supported annotation labels are: - name: to specify argument name - input_id: to specify the dict id mapping for output TextEncodingDict columns. If argument type follows an identifier, it will be mapped to name annotations. For example, the following argument type specifications are equivalent: Int8 a Int8 | name=a Template type specifications is a comma separated list of template type assignments where values are lists of argument type names. For instance: T = [Int8, Int16, Int32, Float], V = [Float, Double]
def generate_TableFunctionsFactory_init.add_method | ( | i, | |
chunk | |||
) |
Definition at line 2005 of file generate_TableFunctionsFactory_init.py.
References join().
Referenced by add_methods().
def generate_TableFunctionsFactory_init.add_methods | ( | add_stmts | ) |
Definition at line 2012 of file generate_TableFunctionsFactory_init.py.
References add_method().
def generate_TableFunctionsFactory_init.build_preflight_function | ( | fn_name, | |
sizer, | |||
input_types, | |||
output_types, | |||
uses_manager | |||
) |
Definition at line 1770 of file generate_TableFunctionsFactory_init.py.
References format_function_args().
Referenced by parse_annotations().
def generate_TableFunctionsFactory_init.build_template_function_call | ( | caller, | |
called, | |||
input_types, | |||
output_types, | |||
uses_manager | |||
) |
Definition at line 1756 of file generate_TableFunctionsFactory_init.py.
References format_function_args().
Referenced by parse_annotations().
def generate_TableFunctionsFactory_init.call_methods | ( | add_stmts | ) |
Definition at line 2016 of file generate_TableFunctionsFactory_init.py.
def generate_TableFunctionsFactory_init.find_comma | ( | line | ) |
Definition at line 367 of file generate_TableFunctionsFactory_init.py.
Referenced by generate_TableFunctionsFactory_init.Bracket.parse().
def generate_TableFunctionsFactory_init.find_signatures | ( | input_file | ) |
Returns a list of parsed UDTF signatures.
Definition at line 1660 of file generate_TableFunctionsFactory_init.py.
References join(), line_is_incomplete(), heavyai.open(), split(), and run_benchmark_import.type.
Referenced by parse_annotations().
def generate_TableFunctionsFactory_init.format_annotations | ( | annotations_ | ) |
Definition at line 1830 of file generate_TableFunctionsFactory_init.py.
References join().
Referenced by parse_annotations().
def generate_TableFunctionsFactory_init.format_function_args | ( | input_types, | |
output_types, | |||
uses_manager, | |||
use_generic_arg_name, | |||
emit_output_args | |||
) |
Definition at line 1728 of file generate_TableFunctionsFactory_init.py.
References join().
Referenced by build_preflight_function(), and build_template_function_call().
def generate_TableFunctionsFactory_init.is_cpu_function | ( | sig | ) |
Definition at line 1852 of file generate_TableFunctionsFactory_init.py.
References uses_manager().
Referenced by parse_annotations().
def generate_TableFunctionsFactory_init.is_gpu_function | ( | sig | ) |
Definition at line 1862 of file generate_TableFunctionsFactory_init.py.
References uses_manager().
Referenced by parse_annotations().
def generate_TableFunctionsFactory_init.is_identifier_cursor | ( | identifier | ) |
Definition at line 385 of file generate_TableFunctionsFactory_init.py.
Referenced by generate_TableFunctionsFactory_init.Parser.parse_composed().
def generate_TableFunctionsFactory_init.is_template_function | ( | sig | ) |
Definition at line 1843 of file generate_TableFunctionsFactory_init.py.
Referenced by parse_annotations().
def generate_TableFunctionsFactory_init.line_is_incomplete | ( | line | ) |
Definition at line 379 of file generate_TableFunctionsFactory_init.py.
Referenced by find_signatures().
def generate_TableFunctionsFactory_init.must_emit_preflight_function | ( | sig, | |
sizer | |||
) |
Definition at line 1820 of file generate_TableFunctionsFactory_init.py.
Referenced by parse_annotations().
def generate_TableFunctionsFactory_init.parse_annotations | ( | input_files | ) |
Definition at line 1871 of file generate_TableFunctionsFactory_init.py.
References build_preflight_function(), build_template_function_call(), find_signatures(), format_annotations(), is_cpu_function(), is_gpu_function(), is_template_function(), join(), and must_emit_preflight_function().
def generate_TableFunctionsFactory_init.product_dict | ( | kwargs | ) |
Definition at line 767 of file generate_TableFunctionsFactory_init.py.
Referenced by generate_TableFunctionsFactory_init.TemplateTransformer.visit_udtf_node().
def generate_TableFunctionsFactory_init.tostring | ( | obj | ) |
Definition at line 165 of file generate_TableFunctionsFactory_init.py.
def generate_TableFunctionsFactory_init.uses_manager | ( | sig | ) |
Definition at line 1848 of file generate_TableFunctionsFactory_init.py.
Referenced by table_functions::TableFunctionsFactory.add(), is_cpu_function(), is_gpu_function(), and com.mapd.parser.server.ExtensionFunctionSignatureParser.toSignature().
int generate_TableFunctionsFactory_init.ADD_FUNC_CHUNK_SIZE = 100 |
Definition at line 2003 of file generate_TableFunctionsFactory_init.py.
list generate_TableFunctionsFactory_init.canonical_input_files = [input_file[input_file.find("/QueryEngine/") + 1:] for input_file in input_files] |
Definition at line 1999 of file generate_TableFunctionsFactory_init.py.
string generate_TableFunctionsFactory_init.content |
Definition at line 2020 of file generate_TableFunctionsFactory_init.py.
tuple generate_TableFunctionsFactory_init.cpu_output_header = os.path.splitext(output_filename) |
Definition at line 1993 of file generate_TableFunctionsFactory_init.py.
tuple generate_TableFunctionsFactory_init.dirname = os.path.dirname(output_filename) |
Definition at line 2117 of file generate_TableFunctionsFactory_init.py.
tuple generate_TableFunctionsFactory_init.f = open(output_filename, 'w') |
Definition at line 2127 of file generate_TableFunctionsFactory_init.py.
tuple generate_TableFunctionsFactory_init.gpu_output_header = os.path.splitext(output_filename) |
Definition at line 1994 of file generate_TableFunctionsFactory_init.py.
string generate_TableFunctionsFactory_init.header_content |
Definition at line 2108 of file generate_TableFunctionsFactory_init.py.
list generate_TableFunctionsFactory_init.header_includes = ['#include "' + canonical_input_file + '"' for canonical_input_file in canonical_input_files] |
Definition at line 2000 of file generate_TableFunctionsFactory_init.py.
list generate_TableFunctionsFactory_init.input_files = [os.path.join(os.path.dirname(__file__), 'test_udtf_signatures.hpp')] |
Definition at line 1984 of file generate_TableFunctionsFactory_init.py.
string generate_TableFunctionsFactory_init.OutputBufferSizeTypes |
Definition at line 82 of file generate_TableFunctionsFactory_init.py.
string generate_TableFunctionsFactory_init.separator = '$=>$' |
Definition at line 78 of file generate_TableFunctionsFactory_init.py.
Referenced by foreign_storage::anonymous_namespace{AbstractFileStorageDataWrapper.cpp}.append_file_path(), ai.heavy.jdbc.HeavyAIEscapeFunctions.appendCall(), foreign_storage::AbstractFileStorageDataWrapper.getFullFilePath(), import_export.import_thread_shapefile(), and pop_n_rows_from_merged_heaps_gpu().
tuple generate_TableFunctionsFactory_init.Signature = namedtuple('Signature', ['name', 'inputs', 'outputs', 'input_annotations', 'output_annotations', 'function_annotations', 'sizer']) |
Definition at line 80 of file generate_TableFunctionsFactory_init.py.
Referenced by generate_TableFunctionsFactory_init.DeclBracketTransformer.visit_udtf_node().
string generate_TableFunctionsFactory_init.SupportedAnnotations |
Definition at line 86 of file generate_TableFunctionsFactory_init.py.
string generate_TableFunctionsFactory_init.SupportedFunctionAnnotations |
Definition at line 91 of file generate_TableFunctionsFactory_init.py.
tuple generate_TableFunctionsFactory_init.translate_map |
Definition at line 95 of file generate_TableFunctionsFactory_init.py.