FAQ
Q: I have never taken machine learning, deep learning, or NLP courses. Can I enroll in the class?
A: Please check the prerequisite. Prior knowledge of machine learning is preferred. Prior course on NLP is NOT required. Otherwise you will need more effort for homework. Please use your judgment to determine whether you will be able to complete the course.
Q: Could you share a list of resources and papers that would help me be ready for class?
A: The best resource for cuda programming is Programming Massively Parallel Processors, 3rd Ed. You may access from CMU library.
Q: What is the requirement for computer system course?
A Knowledge of computer system and architeture is preferred.
Q: how heavy will this course be (in terms of hours/week)?
A: Depending on your prior knowledge and courses, it would be 12 hours if you have already taken some machine learning course and are comfortable in C programming.
Q: What is the prerequisite knowledge in Programming?
A: Students should be comfortable in programming with Python and C/C++. If you are not familiar with those, please take a C/C++ course before this course (e.g. 15122).
Q: Is prior knowledge of LLM required?
A: No prior knowledge of LLM is required.
Q: Is this course similar to 11667? What is the difference?
A: 11667 focuses on models, learning algorithms and applications. 11868 focuses on building systems for LLM, including training, serving, and maintaining. System performance, latency, reliability, product aspects are taught in this course.
Q: What kind of jobs/applications can I do after taking the course?
A: You will be able to develop a mini full stack system like OpenAI/Anthropic ChatGPT for your own research and applications. You will get a better chance to join the system and fundamental learning teams of those companies working on LLMs (rather than just prompt engineering).
Q: I do not want to write system low-level code but I still want to learn about LLM for application. Shall I take this course?
A: 11667 will be the recommended one for you.
Q: Are there projects?
A: Yes. There is a team project component.
Q: Can non-Computer Science students take this course?
A: Non-CS students who satisfy this course prerequisite are welcome. If you do not have much programming experience in C/C++, it would be extremely challenging to complete some of the homework and the project.
Q: Will this course be offered online?
A: It is in person expected. In person participation and discussion are essential components of the course.
Q: I am on a waiting list. How likely will I be admitted?
A: If you satisfy the prerequisite, please stay in the first two weeks. There will be a vacancy.
Q: May I audit the course?
A: There is no audit option for this course since university requires accommodating all students on the waitlist first and there is a long waitlist currently.