OmniSciDB
bf83d84833
|
#include <CsvReader.h>
Public Member Functions | |
CsvReader (const std::string &file_path, const import_export::CopyParams ©_params) | |
virtual | ~CsvReader ()=default |
virtual size_t | read (void *buffer, size_t max_size)=0 |
virtual bool | isScanFinished ()=0 |
virtual size_t | readRegion (void *buffer, size_t offset, size_t size)=0 |
virtual size_t | getRemainingSize ()=0 |
virtual bool | isRemainingSizeKnown ()=0 |
virtual void | checkForMoreRows (size_t file_offset, const ForeignServer *server_options=nullptr, const UserMapping *user_mapping=nullptr) |
virtual void | serialize (rapidjson::Value &value, rapidjson::Document::AllocatorType &allocator) const =0 |
Protected Attributes | |
import_export::CopyParams | copy_params_ |
std::string | file_path_ |
Definition at line 34 of file CsvReader.h.
|
inline |
Definition at line 36 of file CsvReader.h.
|
virtualdefault |
|
inlinevirtual |
Rescan the target files Throws an exception if the rescan fails (ie files are not in a valid appended state or not supported)
file_offset | - where to resume the scan from (end of the last row) as not all of the bytes may have been consumed by the upstream compoennet |
server_options | - only needed for S3 backed CSV |
user_mapping | - only needed for S3 backed CSV |
Reimplemented in foreign_storage::LocalMultiFileReader, foreign_storage::CompressedFileReader, and foreign_storage::SingleFileReader.
Definition at line 84 of file CsvReader.h.
|
pure virtual |
Implemented in foreign_storage::MultiFileReader, foreign_storage::CompressedFileReader, and foreign_storage::SingleFileReader.
|
pure virtual |
Implemented in foreign_storage::MultiFileReader, foreign_storage::CompressedFileReader, and foreign_storage::SingleFileReader.
|
pure virtual |
Implemented in foreign_storage::MultiFileReader, foreign_storage::CompressedFileReader, and foreign_storage::SingleFileReader.
Referenced by foreign_storage::dispatch_metadata_scan_requests(), and import_export::delimited_parser::find_row_end_pos().
|
pure virtual |
Read up to max_size bytes from archive into buffer starting starting from the end of the last read
buffer | - buffer to load into |
max_size | - maximum number of bytes to read into the buffer |
Implemented in foreign_storage::MultiFileReader, foreign_storage::CompressedFileReader, and foreign_storage::SingleFileReader.
Referenced by foreign_storage::dispatch_metadata_scan_requests(), and import_export::delimited_parser::find_row_end_pos().
|
pure virtual |
Read up to max_size bytes from archive, starting at given offset isScanFinished() must return true to use readRegion
buffer | - buffer to load into |
offset | - starting point into the archive to read |
size | - maximum number of bytes to read into the buffer |
Implemented in foreign_storage::MultiFileReader, foreign_storage::CompressedFileReader, and foreign_storage::SingleFileReader.
Referenced by foreign_storage::parse_file_regions().
|
pure virtual |
Serialize internal state to given json object This Json will later be used to restore the reader state through a constructor must be called when isScanFinished() is true
value | - json object to store needed state to this function can store any needed data or none |
allocator | - allocator to use for json contruction |
Implemented in foreign_storage::MultiFileReader, foreign_storage::CompressedFileReader, and foreign_storage::SingleFileReader.
|
protected |
Definition at line 102 of file CsvReader.h.
Referenced by foreign_storage::LocalMultiFileReader::insertFile(), foreign_storage::LocalMultiFileReader::LocalMultiFileReader(), foreign_storage::MultiFileReader::read(), foreign_storage::CompressedFileReader::readInternal(), foreign_storage::MultiFileReader::readRegion(), and foreign_storage::CompressedFileReader::skipHeader().
|
protected |