OmniSciDB
085a039ca4
|
Classes | |
class | Declaration |
class | Bracket |
class | TokenizeException |
class | ParserException |
class | TransformerException |
class | Token |
class | Tokenize |
class | AstVisitor |
class | AstTransformer |
class | AstPrinter |
class | AstDebugger |
class | TemplateTransformer |
class | FixRowMultiplierPosArgTransformer |
class | RenameNodesTransformer |
class | TextEncodingDictTransformer |
class | FieldAnnotationTransformer |
class | SupportedAnnotationsTransformer |
class | DeclBracketTransformer |
class | Node |
class | IterableNode |
class | UdtfNode |
class | ArgNode |
class | TypeNode |
class | PrimitiveNode |
class | ComposedNode |
class | AnnotationNode |
class | TemplateNode |
class | Pipeline |
class | Parser |
Functions | |
def | tostring |
def | find_comma |
def | line_is_incomplete |
def | is_identifier_cursor |
def | product_dict |
def | find_signatures |
def | format_function_args |
def | build_template_function_call |
def | build_preflight_function |
def | must_emit_preflight_function |
def | format_annotations |
def | is_template_function |
def | uses_manager |
def | is_cpu_function |
def | is_gpu_function |
def | parse_annotations |
def | add_method |
def | add_methods |
def | call_methods |
Variables | |
string | separator = '$=>$' |
tuple | Signature = namedtuple('Signature', ['name', 'inputs', 'outputs', 'input_annotations', 'output_annotations', 'function_annotations', 'sizer']) |
string | ExtArgumentTypes |
string | OutputBufferSizeTypes |
string | SupportedAnnotations |
string | SupportedFunctionAnnotations |
tuple | translate_map |
list | input_files = [os.path.join(os.path.dirname(__file__), 'test_udtf_signatures.hpp')] |
tuple | cpu_output_header = os.path.splitext(output_filename) |
tuple | gpu_output_header = os.path.splitext(output_filename) |
list | canonical_input_files = [input_file[input_file.find("/QueryEngine/") + 1:] for input_file in input_files] |
list | header_includes = ['#include "' + canonical_input_file + '"' for canonical_input_file in canonical_input_files] |
int | ADD_FUNC_CHUNK_SIZE = 100 |
string | content |
string | header_content |
tuple | dirname = os.path.dirname(output_filename) |
tuple | f = open(output_filename, 'w') |
Given a list of input files, scan for lines containing UDTF specification statements in the following form: UDTF: function_name(<arguments>) -> <output column types> (, <template type specifications>)? where <arguments> is a comma-separated list of argument types. The argument types specifications are: - scalar types: Int8, Int16, Int32, Int64, Float, Double, Bool, TextEncodingDict, etc - column types: ColumnInt8, ColumnInt16, ColumnInt32, ColumnInt64, ColumnFloat, ColumnDouble, ColumnBool, etc - column list types: ColumnListInt8, ColumnListInt16, ColumnListInt32, ColumnListInt64, ColumnListFloat, ColumnListDouble, ColumnListBool, etc - cursor type: Cursor<t0, t1, ...> where t0, t1 are column or column list types - output buffer size parameter type: RowMultiplier<i>, ConstantParameter<i>, Constant<i>, TableFunctionSpecifiedParameter<i> where i is a literal integer. The output column types is a comma-separated list of column types, see above. In addition, the following equivalents are suppored: Column<T> == ColumnT ColumnList<T> == ColumnListT Cursor<T, V, ...> == Cursor<ColumnT, ColumnV, ...> int8 == int8_t == Int8, etc float == Float, double == Double, bool == Bool T == ColumnT for output column types RowMultiplier == RowMultiplier<i> where i is the one-based position of the sizer argument when no sizer argument is provided, Constant<1> is assumed Argument types can be annotated using `|' (bar) symbol after an argument type specification. An annotation is specified by a label and a value separated by `=' (equal) symbol. Multiple annotations can be specified by using `|` (bar) symbol as the annotations separator. Supported annotation labels are: - name: to specify argument name - input_id: to specify the dict id mapping for output TextEncodingDict columns. If argument type follows an identifier, it will be mapped to name annotations. For example, the following argument type specifications are equivalent: Int8 a Int8 | name=a Template type specifications is a comma separated list of template type assignments where values are lists of argument type names. For instance: T = [Int8, Int16, Int32, Float], V = [Float, Double]
def generate_TableFunctionsFactory_init.add_method | ( | i, | |
chunk | |||
) |
Definition at line 1935 of file generate_TableFunctionsFactory_init.py.
References join().
Referenced by add_methods().
def generate_TableFunctionsFactory_init.add_methods | ( | add_stmts | ) |
Definition at line 1942 of file generate_TableFunctionsFactory_init.py.
References add_method().
def generate_TableFunctionsFactory_init.build_preflight_function | ( | fn_name, | |
sizer, | |||
input_types, | |||
output_types, | |||
uses_manager | |||
) |
Definition at line 1701 of file generate_TableFunctionsFactory_init.py.
References format_function_args().
Referenced by parse_annotations().
def generate_TableFunctionsFactory_init.build_template_function_call | ( | caller, | |
called, | |||
input_types, | |||
output_types, | |||
uses_manager | |||
) |
Definition at line 1687 of file generate_TableFunctionsFactory_init.py.
References format_function_args().
Referenced by parse_annotations().
def generate_TableFunctionsFactory_init.call_methods | ( | add_stmts | ) |
Definition at line 1946 of file generate_TableFunctionsFactory_init.py.
def generate_TableFunctionsFactory_init.find_comma | ( | line | ) |
Definition at line 355 of file generate_TableFunctionsFactory_init.py.
Referenced by generate_TableFunctionsFactory_init.Bracket.parse().
def generate_TableFunctionsFactory_init.find_signatures | ( | input_file | ) |
Returns a list of parsed UDTF signatures.
Definition at line 1594 of file generate_TableFunctionsFactory_init.py.
References line_is_incomplete(), heavyai.open(), split(), and run_benchmark_import.type.
Referenced by parse_annotations().
def generate_TableFunctionsFactory_init.format_annotations | ( | annotations_ | ) |
Definition at line 1760 of file generate_TableFunctionsFactory_init.py.
References join().
Referenced by parse_annotations().
def generate_TableFunctionsFactory_init.format_function_args | ( | input_types, | |
output_types, | |||
uses_manager, | |||
use_generic_arg_name, | |||
emit_output_args | |||
) |
Definition at line 1659 of file generate_TableFunctionsFactory_init.py.
References join().
Referenced by build_preflight_function(), and build_template_function_call().
def generate_TableFunctionsFactory_init.is_cpu_function | ( | sig | ) |
Definition at line 1782 of file generate_TableFunctionsFactory_init.py.
References uses_manager().
Referenced by parse_annotations().
def generate_TableFunctionsFactory_init.is_gpu_function | ( | sig | ) |
Definition at line 1792 of file generate_TableFunctionsFactory_init.py.
References uses_manager().
Referenced by parse_annotations().
def generate_TableFunctionsFactory_init.is_identifier_cursor | ( | identifier | ) |
Definition at line 373 of file generate_TableFunctionsFactory_init.py.
Referenced by generate_TableFunctionsFactory_init.Parser.parse_composed().
def generate_TableFunctionsFactory_init.is_template_function | ( | sig | ) |
Definition at line 1773 of file generate_TableFunctionsFactory_init.py.
Referenced by parse_annotations().
def generate_TableFunctionsFactory_init.line_is_incomplete | ( | line | ) |
Definition at line 367 of file generate_TableFunctionsFactory_init.py.
Referenced by find_signatures().
def generate_TableFunctionsFactory_init.must_emit_preflight_function | ( | sig, | |
sizer | |||
) |
Definition at line 1750 of file generate_TableFunctionsFactory_init.py.
Referenced by parse_annotations().
def generate_TableFunctionsFactory_init.parse_annotations | ( | input_files | ) |
Definition at line 1801 of file generate_TableFunctionsFactory_init.py.
References build_preflight_function(), build_template_function_call(), find_signatures(), format_annotations(), is_cpu_function(), is_gpu_function(), is_template_function(), join(), and must_emit_preflight_function().
def generate_TableFunctionsFactory_init.product_dict | ( | kwargs | ) |
Definition at line 751 of file generate_TableFunctionsFactory_init.py.
Referenced by generate_TableFunctionsFactory_init.TemplateTransformer.visit_udtf_node().
def generate_TableFunctionsFactory_init.tostring | ( | obj | ) |
Definition at line 175 of file generate_TableFunctionsFactory_init.py.
def generate_TableFunctionsFactory_init.uses_manager | ( | sig | ) |
Definition at line 1778 of file generate_TableFunctionsFactory_init.py.
Referenced by table_functions::TableFunctionsFactory.add(), is_cpu_function(), and is_gpu_function().
int generate_TableFunctionsFactory_init.ADD_FUNC_CHUNK_SIZE = 100 |
Definition at line 1933 of file generate_TableFunctionsFactory_init.py.
list generate_TableFunctionsFactory_init.canonical_input_files = [input_file[input_file.find("/QueryEngine/") + 1:] for input_file in input_files] |
Definition at line 1929 of file generate_TableFunctionsFactory_init.py.
string generate_TableFunctionsFactory_init.content |
Definition at line 1950 of file generate_TableFunctionsFactory_init.py.
tuple generate_TableFunctionsFactory_init.cpu_output_header = os.path.splitext(output_filename) |
Definition at line 1923 of file generate_TableFunctionsFactory_init.py.
tuple generate_TableFunctionsFactory_init.dirname = os.path.dirname(output_filename) |
Definition at line 2047 of file generate_TableFunctionsFactory_init.py.
string generate_TableFunctionsFactory_init.ExtArgumentTypes |
Definition at line 82 of file generate_TableFunctionsFactory_init.py.
tuple generate_TableFunctionsFactory_init.f = open(output_filename, 'w') |
Definition at line 2057 of file generate_TableFunctionsFactory_init.py.
tuple generate_TableFunctionsFactory_init.gpu_output_header = os.path.splitext(output_filename) |
Definition at line 1924 of file generate_TableFunctionsFactory_init.py.
string generate_TableFunctionsFactory_init.header_content |
Definition at line 2038 of file generate_TableFunctionsFactory_init.py.
list generate_TableFunctionsFactory_init.header_includes = ['#include "' + canonical_input_file + '"' for canonical_input_file in canonical_input_files] |
Definition at line 1930 of file generate_TableFunctionsFactory_init.py.
list generate_TableFunctionsFactory_init.input_files = [os.path.join(os.path.dirname(__file__), 'test_udtf_signatures.hpp')] |
Definition at line 1914 of file generate_TableFunctionsFactory_init.py.
string generate_TableFunctionsFactory_init.OutputBufferSizeTypes |
Definition at line 92 of file generate_TableFunctionsFactory_init.py.
string generate_TableFunctionsFactory_init.separator = '$=>$' |
Definition at line 78 of file generate_TableFunctionsFactory_init.py.
Referenced by foreign_storage::anonymous_namespace{AbstractFileStorageDataWrapper.cpp}.append_file_path(), ai.heavy.jdbc.HeavyAIEscapeFunctions.appendCall(), foreign_storage::AbstractFileStorageDataWrapper.getFullFilePath(), import_export.import_thread_shapefile(), and pop_n_rows_from_merged_heaps_gpu().
tuple generate_TableFunctionsFactory_init.Signature = namedtuple('Signature', ['name', 'inputs', 'outputs', 'input_annotations', 'output_annotations', 'function_annotations', 'sizer']) |
Definition at line 80 of file generate_TableFunctionsFactory_init.py.
Referenced by generate_TableFunctionsFactory_init.DeclBracketTransformer.visit_udtf_node().
string generate_TableFunctionsFactory_init.SupportedAnnotations |
Definition at line 96 of file generate_TableFunctionsFactory_init.py.
string generate_TableFunctionsFactory_init.SupportedFunctionAnnotations |
Definition at line 101 of file generate_TableFunctionsFactory_init.py.
tuple generate_TableFunctionsFactory_init.translate_map |
Definition at line 105 of file generate_TableFunctionsFactory_init.py.