v2.0.0 Now Availableon npm →

Type-safe CSV & Excel ingestion for TypeScript.

Parse, validate, and process massive datasets through one headless pipeline. Bring your own UI, we handle the heavy lifting.

pnpm add @izanagi-labs/ingestxnpm
CSV
XLSX
IngestX
Parse
Schema Validation
Stream Chunk
✓ Valid
✕ Invalid

Schema Validation

Define exactly what valid data looks like using the built-in, fully typed ix schema builder.

Streaming & Chunking

Process massive datasets without freezing the browser or treating everything as one giant result.

CSV + Excel

Use a single unified ingestion pipeline across common tabular formats (CSV, XLSX, XLS).

Lifecycle Control

Start, pause, resume, and cancel ingestion on the fly, with precise progress tracking.

Developer-first API

IngestX handles the ingestion pipeline so you don't have to repeatedly wire together parsing, validation, and result accumulation.

  • Schema-first architecture
  • Fully typed in TypeScript
  • Headless implementation
  • Lightweight footprint
ingestion.ts
import { ingest, ix } from "@izanagi-labs/ingestx";

// Define exactly what your data should look like
const columns = [
{
key: "email",
name: "Email Address",
matchHeader: (header) => header.toLowerCase().includes("email"),
schema: ix.string().regex(/@/),
}
];

const ingestion = ingest({
file,
columns,
onProgress: (progress) => {
console.log(\`Processing... ${(progress.percentage * 100).toFixed(0)}%\`);
}
});

// Pause and resume on demand
ingestion.pause();
ingestion.resume();

const { data, error } = await ingestion.result;

Built for Serious Workloads

IngestX is engineered to process massive datasets efficiently, bypassing typical browser memory limitations through chunked execution.

Chunked Processing

Files are processed in manageable chunks, ensuring the main thread remains unblocked and responsive during ingestion.

Memory Conscious

CSV ingestion scales incrementally, avoiding the need to load the entire dataset into memory at once.

Bounded Collection

Supports bounded result accumulation or external flushing, allowing you to process multi-gigabyte files securely.

Universal Runtime Support

Designed to run wherever your application does, with specialized adapters for optimal ergonomics.

Browser

Headless ingestion directly in browser applications using standard File objects.

React

Seamless integration via the useIngest hook, managing reactive lifecycle state automatically.

Node

File-path based ingestion for server-side workflows and background processing.

Ready to ingest?

pnpm add @izanagi-labs/ingestxView on npm