Research Intern, Audio-Visual Learning (PhD)

Facebook's mission is to give people the power to build community and bring the world closer together. Through our family of apps and services, we're building a different kind of company that connects billions of people around the world, gives them ways to share what matters most to them, and helps bring people closer together. Whether we're creating new products or helping a small business expand its reach, people at Facebook are builders at heart. Our global teams are constantly iterating, solving problems, and working together to empower people around the world to build community and connect in meaningful ways. Together, we can help people build stronger communities - we're just getting started.

The Facebook Reality Labs (FRL) Research Team brings together a world-class team of researchers, developers, and engineers to create the future of AR and VR, which together will become as universal and essential as smartphones and personal computers are today. We are developing all the technologies needed to enable breakthrough in telepresence, including computer vision, audio, graphics, eye/hand/face/body tracking, perception science, and true telepresence. The FRL Pittsburgh research team is looking for exceptional interns to help us create a revolution in virtual reality: achieving true photorealistic telepresence, where you can be with anyone, anywhere, at any time. We have made some important advances, but it will take a diverse team with a wide spectrum of skills to accomplish this future. We are looking for interns to help us solve real problems in enabling authentic photorealistic telepresence by leveraging audio and audio-visual data captured using our state-of-the-art capture systems. If you have research experience in machine learning applied to audio/speech processing and synthesis, audio-visual learning, and temporal modeling, we expect you will find the work here highly intriguing. Come join us as we make photorealistic telepresence in VR happen!Our internships are twelve (12) to sixteen (16) or twenty four (24) weeks long and we have various start dates throughout the year.

• Solve real problems in enabling authentic photorealistic telepresence using audio and audio-visual data
• Develop robust algorithms for integrating multiple sensors and modalities
• Collaboration with and support of other researchers across various disciplines

• Communication of research agenda, progress, and results

• Currently has, or is in the process of obtaining, a PhD in Computer Science, Machine Learning, Artificial Intelligence or related field
• Must obtain work authorization in country of employment at the time of hire, and maintain ongoing work authorization during employment
• Must be available for 3 month to 6 month internship between January 1, 2021 and December 31, 2021
• Interpersonal skills: cross-group and cross-culture collaboration
• Experience with Machine Learning applied to Audio Processing and Synthesis, or Audio-Visual Learning

• Experience with scientific programming languages such as Python or Matlab

• Intent to return to degree-program after the completion of the internship
• Experience with systems building in C++
• 3+ years of experience with Machine Learning for Sequence Prediction, NLP, or Speech Synthesis
• 3+ years of experience with Machine Learning for Visual Synthesis
• Proven track record of achieving significant results as demonstrated by patents and first-authored publications at leading workshops or conferences such as NeurIPS, ICLR, ICML, ICCV, ECCV, CVPR, SIGGRAPH, ICASSP, Interspeech, or similar

• Demonstrated engineering experience via an internship, work experience, coding competitions, or widely used contributions in open source repositories (e.g., GitHub)

Facebook is proud to be an Equal Opportunity and Affirmative Action employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender, gender identity, gender expression, transgender status, sexual stereotypes, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics. We also consider qualified applicants with criminal histories, consistent with applicable federal, state and local law.Facebook is committed to providing reasonable accommodations for candidates with disabilities in our recruiting process. If you need any assistance or accommodations due to a disability, please let us know at [email protected]