PosixFileArchive Class Reference

#include <PosixFileArchive.h>

Inheritance diagram for PosixFileArchive:

Collaboration diagram for PosixFileArchive:

Public Member Functions
	PosixFileArchive (const std::string url, const bool plain_text)
	~PosixFileArchive () override
void	init_for_read () override
bool	read_next_header () override
bool	read_data_block (const void **buff, size_t *size, int64_t *offset) override
Public Member Functions inherited from Archive
	Archive (const std::string url, const bool plain_text)
virtual	~Archive ()
virtual std::string	archive_error (int err)
virtual int64_t	get_position_compressed () const
virtual int	open ()
virtual int	close ()
virtual ptrdiff_t	read (const void **buff)
const std::string	url_part (const int i)
std::string	entryName ()

Private Attributes
char *	buf = nullptr
FILE *	fp = nullptr

Additional Inherited Members
Static Public Member Functions inherited from Archive
static ptrdiff_t	read (struct archive *a, void *client_data, const void **buff)
static int	open (struct archive *a, void *client_data)
static int	close (struct archive *a, void *client_data)
static void	parse_url (const std::string url, std::map< int, std::string > &url_parts)
Protected Attributes inherited from Archive
std::string	url
std::map< int, std::string >	url_parts
archive *	ar = 0
archive_entry *	entry
bool	plain_text

Detailed Description

Definition at line 29 of file PosixFileArchive.h.

Constructor & Destructor Documentation

PosixFileArchive::PosixFileArchive ( const std::string  url, const bool  plain_text  )

inline

Definition at line 31 of file PosixFileArchive.h.

References buf, g_archive_read_buf_size, init_for_read(), and Archive::url_part().

      : Archive(url, plain_text) {
    // some well-known file.exts imply plain text
    if (!this->plain_text) {
      auto const ext = boost::filesystem::path(url_part(5)).extension();
      this->plain_text = ext == ".csv" || ext == ".tsv" || ext == ".txt" || ext == "";
    }

    if (this->plain_text) {
      buf = new char[g_archive_read_buf_size];
    }

    init_for_read();
  }

Here is the call graph for this function:

PosixFileArchive::~PosixFileArchive ( )

inlineoverride

Definition at line 46 of file PosixFileArchive.h.

References buf, and fp.

                               {
    if (fp) {
      fclose(fp);
    }
    if (buf) {
      delete[] buf;
    }
  }

Member Function Documentation

void PosixFileArchive::init_for_read ( )

inlineoverridevirtual

Reimplemented from Archive.

Definition at line 55 of file PosixFileArchive.h.

References Archive::ar, heavyai::fopen(), fp, Archive::plain_text, and Archive::url_part().

Referenced by PosixFileArchive().

                                {
    auto file_path = url_part(5);
    if (plain_text) {
      if (nullptr == (fp = fopen(file_path.c_str(), "r"))) {
        throw std::runtime_error(std::string("fopen(") + file_path +
                                 "): " + strerror(errno));
      }
    } else {
      if (ARCHIVE_OK != archive_read_open_filename(ar, file_path.c_str(), 1 << 16)) {
        throw std::runtime_error(std::string("fopen(") + file_path +
                                 "): " + strerror(errno));
      }
    }
  }

Here is the call graph for this function:

Here is the caller graph for this function:

bool PosixFileArchive::read_data_block ( const void **  buff, size_t *  size, int64_t *  offset  )

inlineoverridevirtual

Reimplemented from Archive.

Definition at line 78 of file PosixFileArchive.h.

References buf, fp, g_archive_read_buf_size, Archive::get_position_compressed(), Archive::plain_text, and Archive::read_data_block().

                                                                                  {
    if (plain_text) {
      size_t nread;
      if (0 >= (nread = fread(buf, 1, g_archive_read_buf_size, fp))) {
        return false;
      }
      *buff = buf;
      *size = nread;
      *offset = ftell(fp);
      return true;
    } else {
      // need original (compressed) offset for row estimation of compressed files
      auto ret = Archive::read_data_block(buff, size, offset);
      *offset = Archive::get_position_compressed();
      return ret;
    }
  }

Here is the call graph for this function:

bool PosixFileArchive::read_next_header ( )

inlineoverridevirtual

Reimplemented from Archive.

Definition at line 70 of file PosixFileArchive.h.

References fp, Archive::plain_text, and Archive::read_next_header().

                                   {
    if (plain_text) {
      return !feof(fp);
    } else {
      return Archive::read_next_header();
    }
  }

Here is the call graph for this function:

Member Data Documentation

char* PosixFileArchive::buf = nullptr

private

Definition at line 97 of file PosixFileArchive.h.

Referenced by PosixFileArchive(), read_data_block(), and ~PosixFileArchive().

FILE* PosixFileArchive::fp = nullptr

private

Definition at line 98 of file PosixFileArchive.h.

Referenced by init_for_read(), read_data_block(), read_next_header(), and ~PosixFileArchive().

---

The documentation for this class was generated from the following file:

• /home/jenkins-slave/workspace/core-os-doxygen/Archive/PosixFileArchive.h