Entry Level Generative Ai Prompt Engineer Jobs in Chicago, IL

Ready to think boldly, work with some of the world's most recognized brands, and kick-start your career? Welcome to IBM's Associate Program for university hires. From day one, you will collaborate with global clients and IBM teams on projects that help organizations solve tough challenges across digital transformation, cloud strategy, AI adoption, process redesign, analytics, modern data platforms, and agentic AI-enabled data transformation.

As an Associate, you will work alongside a global cohort of diverse, ambitious peers and have access to industry-recognized certifications, digital badges, and a minimum of 40 hours of structured learning per year on IBM's AI-driven learning platform, supported by coaches, mentors, and professional communities across practices. IBM's culture of internal mobility means you can explore new technologies, industries, and career paths as your interests evolve.

Bring your curiosity. Grow your skills. Build what's next - like an IBMer. This role is a strong fit for builders who like turning messy data into reliable systems and who want to help make analytics, generative AI, and AI agents useful, reliable, and safe through governed data, trustworthy context, observable pipelines, and secure interfaces to enterprise systems.

Your role and responsibilities

As an Associate Data Engineer, you will help design, build, and improve data platforms, data products, and services that support analytics, machine learning, generative AI, and agentic AI solutions. You will work across data gathering, ingestion, transformation, storage, batch and real-time processing, semantic enrichment, retrieval, APIs, visualization, data quality, observability, and governance.

Collaborating closely with diverse teams, you will play an important role in selecting suitable data management systems and identifying the critical data needed for insightful analysis. As a Data Engineer, you will help tackle challenges related to database integration, data quality, and complex structured and unstructured datasets.

Key Responsibilities may include

• Assisting designing and implementing scalable data architecture, data products, and management systems for modern cloud environments, analytics, and AI-enabled use cases.
• Work on optimizing existing data pipelines, retrieval indexes, and data services for improved performance, reliability, data quality, and freshness of AI-ready context.
• Collect, prepare, and analyze structured, semi-structured, and unstructured data to identify trends, providing clients with actionable insights that enhance marketing, operational, and business practices.
• Participate in troubleshooting data-related issues, working to solve data quality challenges, retrieval-quality gaps, processing failures, and inconsistencies affecting analytics, generative AI, or agentic workflows.
• Create visually compelling and user-friendly dashboards, reports, and observability views to communicate findings, pipeline health, and AI system insights to both technical and non-technical stakeholders.
• Ensure data integrity, accuracy, reliability, lineage, and access control through rigorous data cleaning, validation, preprocessing, cataloging, and governance practices.
• Work with project teams to prioritize and translate client requirements into current and future operational scenarios, processes, models, use cases, data products, APIs, tool interfaces, plans, and solutions; collaborate with clients, architects, and AI engineers.
• Present analytical findings, data quality insights, and recommendations clearly and concisely, demonstrating the value of data-driven and AI-enabled decision-making to clients.
• Work with cross-functional teams to tackle complex business problems, utilizing data expertise across cloud platforms, RAG, vector search, APIs, responsible AI, and agent orchestration patterns while staying current on modern data stack trends.

Consulting And Collaboration Skills

• Analyze business processes and application portfolios to identify where teams need better data, context, tools, automation, or process optimization.
• Use Agile ways of working, planning, and project-management practices to deliver production-ready data and AI solutions.
• Communicate with curiosity, clarity, and empathy; ask insightful questions about data meaning, risk, governance, and business impact.

Required education

High School Diploma/GED

Preferred education

Bachelor's Degree

Required technical and professional expertise

• High School Diploma/GED.
• Foundational understanding of data engineering concepts, including data pipelines, databases, APIs, distributed processing, ETL/ELT, data modeling, or data products.
• Basic understanding of cloud computing environments such as AWS, Azure, Google Cloud, IBM Cloud, or similar platforms.
• Ability to apply foundational statistical, machine learning, or information retrieval concepts to data preparation, analysis, search, or model-support work.
• Interest in AI/ML, generative AI, agentic AI, intelligent automation, RAG, LLM-powered systems, or enterprise AI platforms.
• Strong analytical thinking, problem solving, adaptability, teamwork, and communication skills.
• Willingness to travel up to 100%, based on project requirements.

Preferred technical and professional experience

• Bachelor’s degree in a related field such as Computer Science, Data Science, Statistics, Mathematics, MIS, Engineering, AI/ML, or another quantitative field.
• Coursework, projects, internship experience, or portfolio work involving data engineering, software engineering, cloud platforms, analytics, AI/ML, or modern data products.
• Experience with technologies such as Spark, Hadoop, Kafka, Airflow, dbt, Databricks, Snowflake, Delta Lake, Linux, or similar platforms.
• Familiarity with LLMs, embeddings, vector databases such as Pinecone, Weaviate, or pgvector, retrieval systems, prompt workflows, RAG, and AI agent architectures.
• Exposure to orchestration and agentic AI frameworks such as LangChain, LangGraph, LlamaIndex, Semantic Kernel, AutoGen, MCP-based tooling, or similar tools.
• Understanding of Git, containers, APIs, testing frameworks, CI/CD, Kubernetes, observability, data governance, privacy, security, or responsible AI practices.
• Preferred certifications, coursework, or credentials such as SnowProCore, Google Associate Cloud Engineer, Google Data Engineer coursework, or related cloud/data credentials.
• Familiarity with AI coding tools and GenAI concepts, including prompt engineering, RAG, fine-tuning, and model evaluation.

IBM Consulting is IBM’s consulting and global professional services business, with market leading capabilities in business and technology transformation. With deep expertise in many industries, we offer strategy, experience, technology, and operations services to many of the most innovative and valuable companies in the world. Our people are focused on accelerating our clients’ businesses through the power of collaboration. We believe in the power of technology responsibly used to help people, partners and the planet.

In a world where technology never stands still, we understand that, dedication to our clients success, innovation that matters, and trust and personal responsibility in all our relationships, lives in what we do as IBMers as we strive to be the catalyst that makes the world work better.

Being an IBMer means you’ll be able to learn and develop yourself and your career, you’ll be encouraged to be courageous and experiment everyday, all whilst having continuous trust and support in an environment where everyone can thrive whatever their personal or professional background.

Our IBMers are growth minded, always staying curious, open to feedback and learning new information and skills to constantly transform themselves and our company. They are trusted to provide on-going feedback to help other IBMers grow, as well as collaborate with colleagues keeping in mind a team focused approach to include different perspectives to drive exceptional outcomes for our customers. The courage our IBMers have to make critical decisions everyday is essential to IBM becoming the catalyst for progress, always embracing challenges with resources they have to hand, a can-do attitude and always striving for an outcome focused approach within everything that they do.

Are you ready to be an IBMer?

IBM’s greatest invention is the IBMer. We believe that through the application of intelligence, reason and science, we can improve business, society and the human condition, bringing the power of an open hybrid cloud and AI strategy to life for our clients and partners around the world.

Restlessly reinventing since 1911, we are not only one of the largest corporate organizations in the world, we’re also one of the biggest technology and consulting employers, with many of the Fortune 500 companies relying on the IBM Cloud to run their business.

At IBM, we pride ourselves on being an early adopter of artificial intelligence, quantum computing and blockchain. Now it’s time for you to join us on our journey to being a responsible technology innovator and a force for good in the world.

IBM is proud to be an equal-opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender, gender identity or expression, sexual orientation, national origin, genetics, pregnancy, disability, neurodivergence, age, or other characteristics protected by the applicable law. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.

IBM offers a competitive and comprehensive benefits program. Eligible employees may have access to:

- Healthcare benefits including medical & prescription drug coverage, dental, vision, and mental health & well being

- Financial programs such as 401(k), cash balance pension plan, the IBM Employee Stock Purchase Plan, financial counseling, life insurance, short & long- term disability coverage, and opportunities for performance based salary incentive programs

- Generous paid time off including 12 holidays, minimum 56 hours sick time, 120 hours vacation, 12 weeks parental bonding leave in accordance with IBM Policy, and other Paid Care Leave programs. IBM also offers paid family leave benefits to eligible employees where required by applicable law

- Training and educational resources on our personalized, AI-driven learning platform where IBMers can grow skills and obtain industry-recognized certifications to achieve their career goals

- Diverse and inclusive employee resource groups, giving & volunteer opportunities, and discounts on retail products, services & experiences

We consider qualified applicants with criminal histories, consistent with applicable law.

This position was posted on the date cited in the key job details section and is anticipated to remain posted for 21 days from this date or less if not needed to fill the role.

IBM will not be providing visa sponsorship for this position now or in the future. Therefore, in order to be considered for this position, you must have the ability to work without a need for current or future visa sponsorship.

The compensation range and benefits for this position are based on a full-time schedule for a full calendar year. The salary will vary depending on your job-related skills, experience and location. Pay increment and frequency of pay will be in accordance with employment classification and applicable laws. For part time roles, your compensation and benefits will be adjusted to reflect your hours. Benefits may be pro-rated for those who start working during the calendar year.

Job Title

Date posted

14-Aug-2026

Job ID

128608

City / Township / Village

Chicago

State / Province

Country

United States

Work arrangement

Onsite

Area of work

Data & Analytics

Employment type

Regular

Contract type

Regular

Projected Minimum Salary per year

71,200.00

Projected Maximum Salary per year

106,800.00

Position type

Entry Level

Up to 100% or 5 days a week (home on weekends - based on project requirements)

Company

(0147) International Business Machines Corporation

Shift

General (daytime)

Is this role a commissionable/sales incentive based position?