AI Test and Evaluation Postdoc
- Req. Number: IRC131904
- Organization : CCS-6/Statistical Sciences
- City, State: Los Alamos, New Mexico
What You Will Do
The Nuclear and Particle Physics and Applications (P-3) and Statistical Sciences groups (CCS-6) at the Los Alamos National Laboratory (LANL) have an opening for an outstanding postdoctoral research associate in the areas of testing and evaluation of large artificial intelligence (AI) models, such as foundation models. Foundation models have been referred to as a paradigm shift where large models are initially trained on a large corpus of data but can be quickly adapted to downstream tasks with little or no additional training data. However, these advances have not yet been tested and understood in high consequence scenarios.
A successful candidate will engage in two or more of the following focus areas:
1) Develop methods, and extend existing methods, for evaluating the performance of a model.
2) Develop robust workflows for testing and evaluating a variety of large AI models.
3) Define out of distribution data for a variety of applications.
4) Develop a specific or universal metrics for foundation models
What You Need
Minimum Job Requirements:
Note to Applicants: In addition to submitting a CV, applicants must include a cover letter describing their research interests.
Desired Qualifications:
Work Location: The work location for this position is onsite and located in Los Alamos, NM. All work locations are at the discretion of management.
Salary: Competitive salaries are based on the date the PhD degree requirements were completed or the degree was awarded. Starting salary for a new graduate is currently $94,500. For more information go to Postdoc Program website at https://www.lanl.gov/careers/career-options/postdoctoral-research/index.php .
Note to Applicants:
In addition to submitting a CV, applicants must include a cover letter describing their research interests.
Postdoctoral appointments are for two years, with the possibility of a third year extension.
Where You Will Work
Located in beautiful northern New Mexico, Los Alamos National Laboratory (LANL) is a multidisciplinary research institution engaged in strategic science on behalf of national security. Our generous benefits package includes:
§ PPO or High Deductible medical insurance with the same large nationwide network
§ Dental and vision insurance
§ Free basic life and disability insurance
§ Paid childbirth and parental leave
§ Award-winning 401(k) (6% matching plus 3.5% annually)
§ Learning opportunities and tuition assistance
§ Flexible schedules and time off (PTO and holidays)
§ Onsite gyms and wellness programs
§ Extensive relocation packages (outside a 50 mile radius)
Additional Details
Directive 206.2 - Employment with Triad requires a favorable decision by NNSA indicating employee is suitable under NNSA Supplemental Directive 206.2. Please note that this requirement applies only to citizens of the United States. Foreign nationals are subject to a similar requirement under DOE Order 142.3A.
No Clearance: Position does not require a security clearance. Selected candidates will be subject to drug testing and other pre-employment background checks.
New-Employment Drug Test: The Laboratory requires successful applicants to complete a new-employment drug test and maintains a substance abuse policy that includes random drug testing. Although New Mexico and other states have legalized the use of marijuana, use and possession of marijuana remain illegal under federal law. A positive drug test for marijuana will result in termination of employment, even if the use was pre-offer.
Equal Opportunity: Los Alamos National Laboratory is an equal opportunity employer and supports a diverse and inclusive workforce. All employment practices are based on qualification and merit, without regard to race, color, national origin, ancestry, religion, age, sex, gender identity, sexual orientation, marital status or spousal affiliation, physical or mental disability, medical conditions, pregnancy, status as a protected veteran, genetic information, or citizenship within the limits imposed by federal laws and regulations. The Laboratory is also committed to making our workplace accessible to individuals with disabilities and will provide reasonable accommodations, upon request, for individuals to participate in the application and hiring process. To request such an accommodation, please send an email to applyhelp@lanl.gov or call 1-505-664-6947 option 2 and then option 3.
The Nuclear and Particle Physics and Applications (P-3) and Statistical Sciences groups (CCS-6) at the Los Alamos National Laboratory (LANL) have an opening for an outstanding postdoctoral research associate in the areas of testing and evaluation of large artificial intelligence (AI) models, such as foundation models. Foundation models have been referred to as a paradigm shift where large models are initially trained on a large corpus of data but can be quickly adapted to downstream tasks with little or no additional training data. However, these advances have not yet been tested and understood in high consequence scenarios.
A successful candidate will engage in two or more of the following focus areas:
1) Develop methods, and extend existing methods, for evaluating the performance of a model.
2) Develop robust workflows for testing and evaluating a variety of large AI models.
3) Define out of distribution data for a variety of applications.
4) Develop a specific or universal metrics for foundation models
What You Need
Minimum Job Requirements:
- Research-level expertise in one or more of the above focus areas
- Demonstrated ability to publish research in top peer-reviewed journals or conference proceedings
- Effective written and oral communication skills with diverse collaborators and audiences
- Familiarity with scientific computing (e.g. Python, Julia, Assembler) and/or high-performance computing
Note to Applicants: In addition to submitting a CV, applicants must include a cover letter describing their research interests.
Desired Qualifications:
- Research-level expertise in two or more of the above focus areas
- Demonstrated ability to work in interdisciplinary project teams and learn about other fields
Work Location: The work location for this position is onsite and located in Los Alamos, NM. All work locations are at the discretion of management.
Salary: Competitive salaries are based on the date the PhD degree requirements were completed or the degree was awarded. Starting salary for a new graduate is currently $94,500. For more information go to Postdoc Program website at https://www.lanl.gov/careers/career-options/postdoctoral-research/index.php .
Note to Applicants:
In addition to submitting a CV, applicants must include a cover letter describing their research interests.
Postdoctoral appointments are for two years, with the possibility of a third year extension.
Where You Will Work
Located in beautiful northern New Mexico, Los Alamos National Laboratory (LANL) is a multidisciplinary research institution engaged in strategic science on behalf of national security. Our generous benefits package includes:
§ PPO or High Deductible medical insurance with the same large nationwide network
§ Dental and vision insurance
§ Free basic life and disability insurance
§ Paid childbirth and parental leave
§ Award-winning 401(k) (6% matching plus 3.5% annually)
§ Learning opportunities and tuition assistance
§ Flexible schedules and time off (PTO and holidays)
§ Onsite gyms and wellness programs
§ Extensive relocation packages (outside a 50 mile radius)
Additional Details
Directive 206.2 - Employment with Triad requires a favorable decision by NNSA indicating employee is suitable under NNSA Supplemental Directive 206.2. Please note that this requirement applies only to citizens of the United States. Foreign nationals are subject to a similar requirement under DOE Order 142.3A.
No Clearance: Position does not require a security clearance. Selected candidates will be subject to drug testing and other pre-employment background checks.
New-Employment Drug Test: The Laboratory requires successful applicants to complete a new-employment drug test and maintains a substance abuse policy that includes random drug testing. Although New Mexico and other states have legalized the use of marijuana, use and possession of marijuana remain illegal under federal law. A positive drug test for marijuana will result in termination of employment, even if the use was pre-offer.
Equal Opportunity: Los Alamos National Laboratory is an equal opportunity employer and supports a diverse and inclusive workforce. All employment practices are based on qualification and merit, without regard to race, color, national origin, ancestry, religion, age, sex, gender identity, sexual orientation, marital status or spousal affiliation, physical or mental disability, medical conditions, pregnancy, status as a protected veteran, genetic information, or citizenship within the limits imposed by federal laws and regulations. The Laboratory is also committed to making our workplace accessible to individuals with disabilities and will provide reasonable accommodations, upon request, for individuals to participate in the application and hiring process. To request such an accommodation, please send an email to applyhelp@lanl.gov or call 1-505-664-6947 option 2 and then option 3.
