CURRICULUM VITAE

Zhengqiang Yin银正强

Senior Machine Learning Engineer

San Francisco Bay Area, CA · Pacific Time

Zhengqiang Yin's profile picture

Profile

I build large-scale LLM inference systems for Ark and BytePlus ModelArk, focusing on distributed serving, performance, reliability, and GPU efficiency across global deployments.

Work Experience

ByteDance, San Jose, CA

2020.12 - Present

Senior Machine Learning Engineer

Part of ByteDance’s AML team, working on LLM inference infrastructure spanning GPU clusters totaling over 10,000 GPUs.

  • Contributed to building Ark’s LLM inference platform from inception to production as an early team member, supporting internal ByteDance workloads and external enterprise customers through 火山方舟 / BytePlus ModelArk.
  • Contributed to distributed inference and performance optimizations, including prefill–decode disaggregation across heterogeneous hardware and persistent KV caching.
  • Contributed to inference API capabilities, including reasoning-mode support and efficient constrained decoding for function calling and JSON Schema–constrained outputs, with minimal performance overhead.
  • Previously worked on machine learning platforms, deep learning training acceleration, and domain-specific large language models.

Microsoft, Remote

2020.06 - 2020.09

Machine Learning Engineer Intern

Worked on search freshness with Bing's Fresh Core team.

  • Built internal tools to support visual debugging of search systems.
  • Investigated methods to identify freshness-sensitive queries in daily search logs.
  • Explored reranking models trained with freshness labels.

iQIYI, Chengdu

2019.12 - 2020.03

Machine Learning Engineer Intern

Worked on automated review generation for iQIYI PaoPao with the Qiwen Tag team at IIG.

  • Compared neural language models for review generation.
  • Deployed a trained review generation model for the operations team.

Skills

  • LLM Inference
  • Distributed Serving
  • Performance Optimization
  • GPU Resource Efficiency

Education

University of Electronic Science and Technology of China

2018 - 2021

MSc in Computer Science

Research focus: Semantic search for code snippets.

Southwest Petroleum University

2014 - 2018

BSc in Computer Science

Languages

  • ChineseNative or bilingual proficiency
  • EnglishLimited working proficiency

Interests

  • Cooking