OmniSciDB  a667adc9c8
 All Classes Namespaces Files Functions Variables Typedefs Enumerations Enumerator Friends Macros Pages
foreign_storage::MetadataScanMultiThreadingParams Struct Reference

Public Attributes

std::queue
< csv_file_buffer_parser::ParseBufferRequest
pending_requests
 
std::mutex pending_requests_mutex
 
std::condition_variable pending_requests_condition
 
std::queue
< csv_file_buffer_parser::ParseBufferRequest
request_pool
 
std::mutex request_pool_mutex
 
std::condition_variable request_pool_condition
 
bool continue_processing
 
std::map< ChunkKey,
std::unique_ptr
< ForeignStorageBuffer > > 
chunk_encoder_buffers
 
std::map< ChunkKey,
Chunk_NS::Chunk
cached_chunks
 
std::mutex chunk_encoder_buffers_mutex
 
std::map< ChunkKey, size_t > chunk_byte_count
 
std::mutex chunk_byte_count_mutex
 

Detailed Description

Data structure used to hold shared objects needed for inter-thread synchronization or objects containing data that is updated by multiple threads while scanning CSV files for metadata.

Definition at line 378 of file CsvDataWrapper.cpp.

Member Data Documentation

std::map<ChunkKey, Chunk_NS::Chunk> foreign_storage::MetadataScanMultiThreadingParams::cached_chunks
std::map<ChunkKey, size_t> foreign_storage::MetadataScanMultiThreadingParams::chunk_byte_count
std::mutex foreign_storage::MetadataScanMultiThreadingParams::chunk_byte_count_mutex

Definition at line 390 of file CsvDataWrapper.cpp.

Referenced by foreign_storage::process_data_blocks().

std::map<ChunkKey, std::unique_ptr<ForeignStorageBuffer> > foreign_storage::MetadataScanMultiThreadingParams::chunk_encoder_buffers
std::mutex foreign_storage::MetadataScanMultiThreadingParams::chunk_encoder_buffers_mutex

Definition at line 388 of file CsvDataWrapper.cpp.

Referenced by foreign_storage::process_data_blocks().

std::condition_variable foreign_storage::MetadataScanMultiThreadingParams::pending_requests_condition
std::queue<csv_file_buffer_parser::ParseBufferRequest> foreign_storage::MetadataScanMultiThreadingParams::request_pool
std::condition_variable foreign_storage::MetadataScanMultiThreadingParams::request_pool_condition
std::mutex foreign_storage::MetadataScanMultiThreadingParams::request_pool_mutex

The documentation for this struct was generated from the following file: