OmniSciDB: analyze_benchmark.BenchmarkLoader Class Reference

All Classes Namespaces Files Functions Variables Typedefs Enumerations Enumerator Friends Macros Groups Pages

Public Member Functions
def	__init__

def	load

def	getFrontAttribute

def	getExistingDataRunLabel

def	getGpuName

def	getRunTableName

def	fetchAttribute

def	fetchQueryNames

Public Attributes
	dir_name

	filename_list

	data

Detailed Description

Definition at line 10 of file analyze_benchmark.py.

Constructor & Destructor Documentation

def analyze_benchmark.BenchmarkLoader.__init__	(	self,
		dir_name,
		filename_list
	)

Definition at line 11 of file analyze_benchmark.py.

 
     def __init__(self, dir_name, filename_list):
         self.dir_name = dir_name
         self.filename_list = filename_list
         self.data = []

analyze_benchmark.BenchmarkLoader.data

data

Definition: analyze_benchmark.py:14

analyze_benchmark.BenchmarkLoader.dir_name

dir_name

Definition: analyze_benchmark.py:12

analyze_benchmark.BenchmarkLoader.__init__

def __init__

Definition: analyze_benchmark.py:11

analyze_benchmark.BenchmarkLoader.filename_list

filename_list

Definition: analyze_benchmark.py:13

Member Function Documentation

def analyze_benchmark.BenchmarkLoader.fetchAttribute	(	self,
		attribute,
		query_names
	)

Definition at line 48 of file analyze_benchmark.py.

References analyze_benchmark.BenchmarkLoader.data.

 
     def fetchAttribute(self, attribute, query_names):
         result = []
         for query in query_names:
             for experiment in self.data:
                 assert attribute in experiment["results"], (
                     attribute + " is not a valid attribute."
                 )
                 if query == experiment["results"]["query_id"]:
                     result.append(experiment["results"][attribute])
                     break
         return result

analyze_benchmark.BenchmarkLoader.fetchAttribute

def fetchAttribute

Definition: analyze_benchmark.py:48

analyze_benchmark.BenchmarkLoader.data

data

Definition: analyze_benchmark.py:14

def analyze_benchmark.BenchmarkLoader.fetchQueryNames ( self )

Definition at line 60 of file analyze_benchmark.py.

References analyze_benchmark.BenchmarkLoader.data.

 
     def fetchQueryNames(self):
         result = []
         for experiment in self.data:
             result.append(experiment["results"]["query_id"])
         return result
 

analyze_benchmark.BenchmarkLoader.data

data

Definition: analyze_benchmark.py:14

analyze_benchmark.BenchmarkLoader.fetchQueryNames

def fetchQueryNames

Definition: analyze_benchmark.py:60

def analyze_benchmark.BenchmarkLoader.getExistingDataRunLabel ( self )

Definition at line 38 of file analyze_benchmark.py.

References analyze_benchmark.BenchmarkLoader.getFrontAttribute().

 
     def getExistingDataRunLabel(self):
         return self.getFrontAttribute("run_label")

analyze_benchmark.BenchmarkLoader.getFrontAttribute

def getFrontAttribute

Definition: analyze_benchmark.py:32

analyze_benchmark.BenchmarkLoader.getExistingDataRunLabel

def getExistingDataRunLabel

Definition: analyze_benchmark.py:38

Here is the call graph for this function:

def analyze_benchmark.BenchmarkLoader.getFrontAttribute	(	self,
		attribute
	)

Definition at line 32 of file analyze_benchmark.py.

References analyze_benchmark.BenchmarkLoader.data.

Referenced by analyze_benchmark.BenchmarkLoader.getExistingDataRunLabel(), analyze_benchmark.BenchmarkLoader.getGpuName(), and analyze_benchmark.BenchmarkLoader.getRunTableName().

 
     def getFrontAttribute(self, attribute):
         if self.data:
             return self.data[0]["results"][attribute]
         else:
             return "None"

analyze_benchmark.BenchmarkLoader.data

data

Definition: analyze_benchmark.py:14

analyze_benchmark.BenchmarkLoader.getFrontAttribute

def getFrontAttribute

Definition: analyze_benchmark.py:32

Here is the caller graph for this function:

def analyze_benchmark.BenchmarkLoader.getGpuName ( self )

Definition at line 41 of file analyze_benchmark.py.

References analyze_benchmark.BenchmarkLoader.getFrontAttribute().

 
     def getGpuName(self):
         return self.getFrontAttribute("run_gpu_name")

analyze_benchmark.BenchmarkLoader.getGpuName

def getGpuName

Definition: analyze_benchmark.py:41

analyze_benchmark.BenchmarkLoader.getFrontAttribute

def getFrontAttribute

Definition: analyze_benchmark.py:32

Here is the call graph for this function:

def analyze_benchmark.BenchmarkLoader.getRunTableName ( self )

Definition at line 44 of file analyze_benchmark.py.

References analyze_benchmark.BenchmarkLoader.getFrontAttribute().

 
     def getRunTableName(self):
         return self.getFrontAttribute("run_table")

analyze_benchmark.BenchmarkLoader.getRunTableName

def getRunTableName

Definition: analyze_benchmark.py:44

analyze_benchmark.BenchmarkLoader.getFrontAttribute

def getFrontAttribute

Definition: analyze_benchmark.py:32

Here is the call graph for this function:

def analyze_benchmark.BenchmarkLoader.load	(	self,
		bench_filename
	)

Definition at line 17 of file analyze_benchmark.py.

References analyze_benchmark.BenchmarkLoader.data, analyze_benchmark.BenchmarkLoader.dir_name, analyze_benchmark.BenchmarkLoader.filename_list, and heavyai.open().

 
     def load(self, bench_filename):
         assert bench_filename in self.filename_list
 
         with open(self.dir_name + bench_filename) as json_file:
             # only load those queries that were successful
             filtered_input_data = filter(
                 lambda experiment: experiment["succeeded"] is True,
                 json.load(json_file),
             )
             # sort queries based on their IDs
             self.data = sorted(
                 filtered_input_data,
                 key=lambda experiment: experiment["results"]["query_id"],
             )