ML verification, deduplication and entity resolution

Entity resolution: canopy clustering plus a Siamese network plus XGBoost (precision 0.98, recall 0.95), merging with provenance tracking.

Citation verification (RAG): DeBERTa-v3 entailment (precision 0.97), source reputation weighting, multi-hop retrieval (ReAct).

Anomaly detection: Isolation Forest plus LSTM-AE (precision 0.92, recall 0.89). Data quality scoring with Great Expectations.

Stack: BGE-M3, Cohere Rerank, Llama-3.1-70B or GPT-4o, DeBERTa-v3, Qdrant, ClickHouse, Airflow.


← Back to services