MULTIMODAL AI · LARGE-SCALE ML · CONTENT INTELLIGENCE

Kanchan Sarkar

Engineering Manager & AI Researcher at TikTok / ByteDance

I lead global teams building production-scale multimodal AI systems across video, image, audio and text — bridging frontier research with systems that operate at internet scale.

Technically, our team develops and deploys advanced LLM, VLM, and multimodal (“Omni”) models that understand text, images, video, and audio. We pre-train internal foundation models and adapt them for large-scale production across a broad range of downstream applications.

Alongside product development, we collaborate with academic institutions including the National University of Singapore and its high-performance computing research labs. Our research spans long-video understanding and grounding, efficient small language models, advanced vision backbones, multimodal representation learning, and speech processing. We regularly publish at top-tier AI conferences and file patents based on our innovations.

We’re hiring across China, Singapore, San Jose, Seattle, and New York. If you’re interested in high-impact AI model development at TikTok, reach out at kanchan.sarkar@tiktok.com.
📍 San Jose, California🎓 IIT Bombay10+ years in production AI
Kanchan Sarkar speaking at Seoul Meta Week 2026
RESEARCH & ENGINEERING

Building AI from research to production

My work focuses on multimodal understanding and efficient machine learning systems, with an emphasis on models that can be deployed reliably at very large scale.

Multimodal Foundation ModelsVideo UnderstandingVideo Similarity & DeduplicationLLMs & VLMsMultimodal EmbeddingsSpeech & Audio IntelligenceContent IntegrityLarge-Scale RetrievalRecommendation Systems
10+Recent top-tier papers
ICML · ICLR · KDD · NeurIPS · ACL & more
50+Peer reviews
4 modalitiesVideo · Image · Audio · Text
1B+Users impacted

“I believe in building AI systems that positively impact billions of lives — by combining research, engineering, and a deep understanding of real-world problems.”

— Kanchan Sarkar
SELECTED PUBLICATIONS

Research with measurable systems impact

MLT-Dedup model architecture
KDD 2026 · ADS

MLT-Dedup: Efficient Large-Scale Online Video Deduplication

Multi-level representations and spatial-temporal matching for scalable near-duplicate video retrieval and precise segment localization.

91% reduction in online repetition @ 90% precision · 5× indexing capacity
MatchLM2Lite distillation architecture
KDD 2026 · Track 2

MatchLM2Lite: A Scalable MLLM-to-Lite Framework for Reproduced Content Identification

Distills multimodal reasoning over video, audio and text from a powerful teacher into an efficient production student.

+6.55 F1 · 35× lower compute · 3K+ QPS
Dynamic Content Moderation dual-path architecture
KDD 2026 · ADS

Dynamic Content Moderation in Livestreams

A production-scale hybrid framework combining supervised classification with MLLM-boosted multimodal similarity matching for evolving livestream content.

Info-Coevolution architecture
ICML 2025

Info-Coevolution: An Efficient Framework for Data-Model Coevolution

Online selective annotation lets data and models coevolve while reducing unnecessary labeling and training.

32% lower annotation & training cost on ImageNet-1K with no performance loss
Evolution of unified multimodal representations: methods, design families, and timeline
ZENODO · PREPRINT · 2026

Unified Multimodal Representation Learning: Architectures, Alignment, and Retrieval

A review of multimodal embeddings, connecting architectures and alignment strategies to retrieval across text, images, video, and audio.

Shared embeddings · Alignment · Cross-modal retrieval
Citation

Kanchan, S., Jana, E., & Agrawal, D. (2026). Unified Multimodal Representation Learning: Architectures, Alignment, and Retrieval. Zenodo. https://doi.org/10.5281/zenodo.23227885

Loop Dropout shared adaptation across loops and loss-reduction comparison
ARXIV · PREPRINT · 2026

Loop Dropout: Regularizing Shared Updates in Looped Language Models

Stochastic masking with inverse-survival rescaling improves shared LoRA adaptation across loops, supporting mathematical reasoning, instruction tuning, and code generation.

No additional trainable parameters or inference computation
ViTok encoder distilled from SigLIP2 and DINOv3-L with masked image modelling
ARXIV · PREPRINT · 2026

ViTok: Improving Dense Semantics in AM-RADIO-Style Multi-Teacher Distillation with PHI-S and Masked Image Modelling

Combines SigLIP2 and DINOv3-L teachers with masked image modelling and PHI-S feature balancing to preserve global recognition and dense semantics.

85.2% CLS kNN on ImageNet-1K · 48.5 mIoU on ADE20K
Taxonomy of efficient long-video understanding methods
PREPRINT · 2026

Efficient Long-Video Understanding and Key Frame Selection: A Survey of Compression, Memory, and Reasoning

A survey of query-aware frame selection, visual-token compression, persistent memory, hierarchical retrieval, and agentic evidence acquisition for efficient long-video understanding.

Compression · Memory · Evidence-grounded reasoning

View all publications on Google Scholar →

INVITED TALKS

Sharing lessons from AI at internet scale

Kanchan Sarkar at Seoul Meta Week 2026
METACON · SEOUL META WEEK 2026

How Recent Advances in LLMs and VLMs Are Transforming Industrial AI Applications

Invited talk on translating advances in foundation models into reliable industrial AI systems serving global-scale products.

Open Frontiers in Industrial AI invited talk
INDUSTRY & ACADEMIC TALKS

From Research to Production: Scaling Multimodal AI Systems for Billions of Users

Lessons in model design, retrieval, efficiency, deployment and iteration when research must survive real-world scale.

EXPERIENCE

AI leadership & production systems

TikTok / ByteDance logo
TikTok / ByteDance2020 — Present · Singapore → San Jose

Engineering Manager · Content Intelligence

Leading global AI research and engineering teams working on multimodal content intelligence, similarity, originality, recommendation quality, content integrity, speech/audio intelligence and large-scale retrieval.

Shopee logo
Shopee2019 — 2020 · Singapore

Senior Data Scientist

Computer vision and e-commerce AI, including product understanding, segmentation, detection and large-scale visual systems.

DataWeave logo
DataWeave2017 — 2018 · Bangalore

Data Engineer · Data Semantics

Multimodal product matching, NLP, review summarization, product description parsing and attribute tagging across large-scale e-commerce catalogs.

Riverbed Technology logo
Riverbed Technology2016 — 2017 · Bangalore

Member of Technical Staff

Developed virtualization and enterprise systems components using C++, Python and Microsoft Azure technologies.

IBM logo
IBM India2013 — 2014 · Bangalore

Associate System Engineer

Developed and optimized enterprise ETL pipelines for large-scale data integration, testing, deployment and performance tuning.

ACADEMIC SERVICE

Research community

Reviewer across leading machine learning, computer vision and data mining venues, including NeurIPS, ICML, ICLR, KDD, WACV and IEEE TCSVT, plus ICML, KDD and ACL workshops.

50+ papers reviewed
EDUCATION

Foundation

Indian Institute of Technology BombayMaster of Technology · Computer Science & Engineering2014 — 2016
IIEST ShibpurBachelor's · Information Technology2010 — 2013