Section:

Reduce Smart Data Extraction package size

Requirements
Package: Smart Data Extraction
Module: Data Extraction

The Smart Data Extraction module uses artificial intelligence in several of its engines, and as a result, can consume a substantial amount of disk space. This can be limiting for some users who need to work in constrained environments with limited storage, such as certain cloud computing environments.

The Data Extraction module is composed of four engines, each with its own file requirements. If you need only a subset of these engines, you can remove files from the package that aren't dependencies of your required engine. Each engine's file dependencies are platform-specific.

The following table provides Linux and Windows file dependencies for each extraction engine and shows which files you can remove when you don't use specific features.

The table below maps each engine to its file dependencies.

Engine Name

Dependencies

Tabular Data Extraction

  • Lib/Linux/TabluarData/*
  • Lib/Linux/OCRModule

Document Structure Recognition

  • Lib/Linux/StructuredOutput
  • Lib/Linux/fonts2.pdf
  • Lib/Linux/tessdata/*

The following files are only required if using Deep Learning Assist:

  • Lib/Linux/AIPageObjectExtractor/AIPageObjectExtractor
  • Lib/Linux/AIPageObjectExtractor/table.onnx
  • Lib/Linux/AIPageObjectExtractor/table_tabular.onnx
  • Lib/Linux/AIPageObjectExtractor/Licenses

Form Field Detection

  • Lib/Linux/AIPageObjectExtractor/AIPageObjectExtractor
  • Lib/Linux/AIPageObjectExtractor/form.onnx
  • Lib/Linux/AIPageObjectExtractor/Licenses

Form Field Key-Value Extraction

  • Lib/Linux/AIPageObjectExtractor/AIPageObjectExtractor
  • Lib/Linux/AIPageObjectExtractor/form.onnx
  • Lib/Linux/AIPageObjectExtractor/kv.onnx
  • Lib/Linux/AIPageObjectExtractor/kv_v.cab
  • Lib/Linux/AIPageObjectExtractor/Licenses

Generic Key-Value Extraction

  • Lib/Linux/AIPageObjectExtractor/AIPageObjectExtractor
  • Lib/Linux/AIPageObjectExtractor/kv.onnx
  • Lib/Linux/AIPageObjectExtractor/kv_v.cab
  • Lib/Linux/AIPageObjectExtractor/Licenses

Document Classification

  • Lib/Linux/AIPageObjectExtractor/AIPageObjectExtractor
  • Lib/Linux/AIPageObjectExtractor/class.onnx
  • Lib/Linux/AIPageObjectExtractor/Licenses

If the engines you are using do not depend on a given file, you are free to remove that file. For example, if you are using the Form Field Key-Value Extraction engine and the Document Structure Recognition engine (without Deep Learning Assist), then you can remove any files that are only needed for the Tabular Data Extraction engine. In this example, you would be left with the following:

Example Package Structure

1Lib
2└── Linux
3    ├── AIPageObjectExtractor
4    │   ├── AIPageObjectExtractor
5    │   ├── class.onnx
6    │   ├── form.onnx
7    │   ├── kv.onnx
8    │   ├── kv_v.cab
9    │   └── Licenses
10    ├── fonts2.pdf
11    ├── StructuredOutput
12    └── tessdata
13        ├── chi_sim.traineddata
14        ├── chi_sim_vert.traineddata
15        ├── chi_tra.traineddata
16        ├── chi_tra_vert.traineddata
17        ├── ell.traineddata
18        ├── eng.traineddata
19        ├── grc.traineddata
20        ├── jpn.traineddata
21        ├── jpn_vert.traineddata
22        ├── kor.traineddata
23        └── kor_vert.traineddata

Did you find this helpful?

Trial setup questions?

Ask experts on Discord

Need other help?

Contact Support

Pricing or product questions?

Contact Sales