You will be part of a large team of research engineers and work on developing large language models specialized to meet the customers' specific needs and culture. You are expected to train models (pretraining, SFT, DPO, etc..), modify existing code, and implement cutting-edge techniques. You will be collaborating with the data engineering team in their data collection, cleaning and preprocessing tasks, and the annotation team with their evaluation tasks. In addition to product based efforts you are expected to keep up with the scientific literature and contribute to it as well by publishing papers.
Requirements
1. Basic Computer Science and Programming
- Data Structures and Algorithms (practice with LeetCode type problems)
- Object Oriented Programming
- optional) Functional Programming
- Writing robust and reusable code according to design patterns
- Ability and willingness to write readable and well documented Python code
- Version Control (git)
2. Machine Learning and Deep Learning
Classical Machine Learning and Deep Learning especially as applied to NLPScikit-Learn, Jupyter Notebook / Lab, Pandas, NumpyAt least one of Pytorch, Tensorflow (not Keras) or JAXAbility to design and implement neural networks from scratch in one of the above frameworksoptional) Model Compression (Quantization, Distillation, Pruning)optional) Reinforcement Learning3. Natural Language Processing
Data Collection and PreprocessingText Representation (e.g. BoW, word embeddings, contextual embeddings)Neural Network Architectures used in NLPLanguage Models (n-gram, masked and causal)optional) Information Retrieval4. Large Language Models
Huggingface transformersIn-context Learning (prompt engineering)Instruction Tuning (SFT)Alignment (e.g. RLHF-PPO, DPO)optional) 3D Parallelism (data, tensor, pipeline)optional) Model Deployment (inference optimizations)Evaluation of LLMs5. Academic Credentials
Degree in Computer Engineering or related fieldsWillingness to follow NLP and LLM literature to stay informed of latest developmentsoptional) Publications in reputable conferences and journals6. Non-technical Requirements
Fluency in written and spoken Englishoptional) Proficiency in Arabic, Portuguese, Spanish or RussianStrong communication skillsBenefits
A real job from day one : We offer you a professional career in one of the leading multinational technology company.Local & international : Reaching more than 190 countries, Huawei is a successful and respected business. We focus on the needs of local costumers by harnessing global expertise and team work. For you, that means exceptional exposure and experience.Great Development Opportunities : We'll support you every step of the way, with hands on experience which includes functional, cross functional and international rotations.Fast growth and ambitious vision.Learning and Development opportunities.