API Reference

Config

• Config

Enrichers

• Text Generation
• Runner
• Prompt Adapters Gemini Adapter
• Prompt Adapters Base
• Sentence Classifier
• Registry
• Embeddings
• Toxicity
• Language Detection
• Bot Detection
• Prompt Template
• Base

Ingest

• Plan
• Pipeline
• Dedup

Inspector

• Inspector

IO

• Archive Stream
• Readers Zip
• Readers Utils
• Readers Parquet
• Readers Json
• Readers Jsonl
• Readers Registry
• Readers Csv Pd
• Readers Tar
• Readers Base

Multistore

• Multistore

Networks

• Streams
• Specs
• API
• Types
• Converters
• IO Utils
• Builders Coaction
• Builders Entity Cooccurrence
• Builders User Interaction
• Builders Bipartite
• Base

Pseudonymizer

• Pii Policy
• Policy
• Pii Engine
• Pseudonyms
• Pseudonymizer
• Redact
• Platform Patterns
• Erasure

Standardizers

• Scored
• Bluesky Dataset
• Bluesky API With Car
• Bluesky API
• Parler
• Truthsocial USC
• Truthsocial
• Koo
• Twitter USC
• Twitter V2
• Twitter V1
• Telegram
• Voatco
• Gab
• Reddit
• Base

Store

• Models Communities
• Models Post Enrichments
• Models Posts
• Models Entities
• Models Account Enrichments
• Models Dataset Meta
• Models Actions
• Models Accounts
• Schema Config
• Utils Db Sanitize
• Utils Geo
• Standard Db