Nikhil Ghosh

Data infra / DBs / DistSys -> ML infra + inference systems engineer in SF. Fan of cortados, Man United, Steph Curry, dogs, the Wiggle, and jazz.


Work

Engineering / LLMs at Anyscale working on batch inference, large scale serving, and Ray. Previously helped launch Workers AI at Cloudflare, and worked on exascale compute and search / ML data infra at Apple under Siri Search.


Writes

Occasional writing on AI, infrastructure, and policy.

All posts →


Reads


Elsewhere