OmniSciDB  bf83d84833
 All Classes Namespaces Files Functions Variables Typedefs Enumerations Enumerator Friends Macros Pages
Public Attributes | List of all members
foreign_storage::MetadataScanMultiThreadingParams Struct Reference

Public Attributes

std::queue
< csv_file_buffer_parser::ParseBufferRequest > 		pending_requests
 
std::mutex pending_requests_mutex
 
std::condition_variable pending_requests_condition
 
std::queue
< csv_file_buffer_parser::ParseBufferRequest > 		request_pool
 
std::mutex request_pool_mutex
 
std::condition_variable request_pool_condition
 
bool continue_processing
 
std::map< ChunkKey,
std::unique_ptr
< ForeignStorageBuffer > > 		chunk_encoder_buffers
 
std::map< ChunkKey,
Chunk_NS::Chunk > 		cached_chunks
 
std::mutex chunk_encoder_buffers_mutex
 
std::map< ChunkKey, size_t > chunk_byte_count
 
std::mutex chunk_byte_count_mutex
 

Detailed Description

Data structure used to hold shared objects needed for inter-thread synchronization or objects containing data that is updated by multiple threads while scanning CSV files for metadata.

Definition at line 491 of file CsvDataWrapper.cpp.

Member Data Documentation

std::map<ChunkKey, Chunk_NS::Chunk> foreign_storage::MetadataScanMultiThreadingParams::cached_chunks

Definition at line 500 of file CsvDataWrapper.cpp.

Referenced by foreign_storage::CsvDataWrapper::populateChunkMetadata(), and foreign_storage::process_data_blocks().

std::map<ChunkKey, size_t> foreign_storage::MetadataScanMultiThreadingParams::chunk_byte_count

Definition at line 502 of file CsvDataWrapper.cpp.

Referenced by foreign_storage::CsvDataWrapper::populateChunkMetadata(), and foreign_storage::process_data_blocks().

std::mutex foreign_storage::MetadataScanMultiThreadingParams::chunk_byte_count_mutex

Definition at line 503 of file CsvDataWrapper.cpp.

Referenced by foreign_storage::process_data_blocks().

std::map<ChunkKey, std::unique_ptr<ForeignStorageBuffer> > foreign_storage::MetadataScanMultiThreadingParams::chunk_encoder_buffers

Definition at line 499 of file CsvDataWrapper.cpp.

Referenced by foreign_storage::CsvDataWrapper::populateChunkMetadata(), and foreign_storage::process_data_blocks().

std::mutex foreign_storage::MetadataScanMultiThreadingParams::chunk_encoder_buffers_mutex

Definition at line 501 of file CsvDataWrapper.cpp.

Referenced by foreign_storage::process_data_blocks().

bool foreign_storage::MetadataScanMultiThreadingParams::continue_processing

Definition at line 498 of file CsvDataWrapper.cpp.

Referenced by foreign_storage::dispatch_metadata_scan_requests(), foreign_storage::get_next_metadata_scan_request(), foreign_storage::CsvDataWrapper::populateChunkMetadata(), and foreign_storage::scan_metadata().

std::queue<csv_file_buffer_parser::ParseBufferRequest> foreign_storage::MetadataScanMultiThreadingParams::pending_requests

Definition at line 492 of file CsvDataWrapper.cpp.

Referenced by foreign_storage::dispatch_metadata_scan_request(), foreign_storage::dispatch_metadata_scan_requests(), and foreign_storage::get_next_metadata_scan_request().

std::condition_variable foreign_storage::MetadataScanMultiThreadingParams::pending_requests_condition

Definition at line 494 of file CsvDataWrapper.cpp.

Referenced by foreign_storage::dispatch_metadata_scan_request(), foreign_storage::dispatch_metadata_scan_requests(), foreign_storage::get_next_metadata_scan_request(), and foreign_storage::CsvDataWrapper::populateChunkMetadata().

std::mutex foreign_storage::MetadataScanMultiThreadingParams::pending_requests_mutex

Definition at line 493 of file CsvDataWrapper.cpp.

Referenced by foreign_storage::dispatch_metadata_scan_request(), foreign_storage::dispatch_metadata_scan_requests(), foreign_storage::get_next_metadata_scan_request(), foreign_storage::CsvDataWrapper::populateChunkMetadata(), and foreign_storage::scan_metadata().

std::queue<csv_file_buffer_parser::ParseBufferRequest> foreign_storage::MetadataScanMultiThreadingParams::request_pool

Definition at line 495 of file CsvDataWrapper.cpp.

Referenced by foreign_storage::add_request_to_pool(), foreign_storage::get_request_from_pool(), and foreign_storage::CsvDataWrapper::populateChunkMetadata().

std::condition_variable foreign_storage::MetadataScanMultiThreadingParams::request_pool_condition

Definition at line 497 of file CsvDataWrapper.cpp.

Referenced by foreign_storage::add_request_to_pool(), and foreign_storage::get_request_from_pool().

std::mutex foreign_storage::MetadataScanMultiThreadingParams::request_pool_mutex

Definition at line 496 of file CsvDataWrapper.cpp.

Referenced by foreign_storage::add_request_to_pool(), and foreign_storage::get_request_from_pool().

The documentation for this struct was generated from the following file: