CTE - AI Assessments and ai

Ideas

In this section, AI with assessments, we navigate the intersection of technology and evaluation in education. In this dynamic landscape, concerns about academic integrity and cheating with AI are prominent. Throughout this section, we'll explore three key assessment avenues: authentic assessment methods, integrating AI into evaluations, and the concept of 'two-lane assessments.'

Assessments and AI

Authentic assessments

Assessment always begins with clear learning objectives. It's about defining what you want your learners to achieve after engaging with your instruction. For example, as a language teacher, the goal might not be to have students memorize hundreds of verbs, but rather to empower them to introduce themselves, hold conversations about preferences, schedule appointments, or discuss food choices.

Once these objectives are set, the focus shifts to visualizing what mastery looks like. Is it a conversation between students? A creative project? Perhaps a self-made video?

This process leads us to authentic assessments that truly reflect and measure the learners' acquired abilities, aligning closely with real-world tasks and skills they'll utilize beyond the classroom.

an image of two students in France in front of the Eifel Tower.

Image created using AI

Assessments that include AI

With AI becoming more and more available, you may want to teach your students how its use relates to your field and you may want to create assessments that include AI. Below are some ideas that you can use as springboards into creating your own meaningful assessments that include AI.

Woman in court arguing with a robot. and a lawyer is present

Image created using AI

Comparative Analysis with AI's Ethical Insights

In an assessment scenario, students can delve into complex ethical dilemmas within business using AI as a tool for analysis. For instance, students might task AI to compare two business cases that present ethical challenges. The AI's analysis could offer insights into the ethical implications of the choices made in these scenarios.

Subsequently, students engage in a deconstruction process, critically evaluating the AI's assessment. They dissect and analyze what the AI got right, areas it missed, and the nuanced considerations it might have overlooked.

This exercise not only encourages students to think critically about the AI's findings but also fosters a deeper understanding of ethical dimensions within business contexts.

AI-Enhanced Research and Presentation

AI can also be integrated into assessment by aiding students in conducting research and enhancing their presentations. Students can utilize AI to gather and analyze data, uncover trends, and present their findings. Assessments can focus on evaluating not only the quality of the research and analysis but also the students' ability to interpret and communicate the insights gleaned from AI-powered research tools.

Here it is critical that students know how to evaluate, fact check, and cite AI. These are skills that will help them know how to evaluate AI produced content, which will help them through out their careers.

Image created using AI

A girls talking to a computer and taking notes at her desk.

Image created using AI

AI-Powered Simulation or Role-Playing Scenarios

Another way to integrate AI into assessment is through simulated scenarios or role-playing exercises powered by AI. For instance, students could engage in a simulated negotiation scenario where AI acts as one of the negotiating parties.

As students navigate the negotiation, AI provides dynamic responses, allowing for a realistic and evolving interaction. Assessments can then focus on analyzing students' decision-making processes, communication skills, and adaptability based on the AI's responses.

You will want to make sure that students reflect on their experience, and are prepared to use the AI tools meaningfully, as well as know how to know whether what is being produces by the AI is accurate.

Two-Lane assessments

The two-lane approach aims for a balance between ensuring learning and promoting human-AI collaboration. While some assessments (lane 1) ensure meeting learning outcomes, most (lane 2) focus on real-world readiness, including AI involvement. To nurture well-rounded, capable students, assessments reflecting authentic, modern settings (lane 2) should carry more weight than those solely ensuring learning (lane 1).

Lane 1

Lane 1 assessments primarily focus on ensuring students meet specific learning outcomes within a course or unit. These assessments are often designed to measure the understanding and mastery of foundational knowledge or skills outlined in the curriculum. They aim to guarantee that students have acquired the fundamental concepts or competencies necessary to progress within a particular course or academic program.

Lane 2

Lane 2 assessments prioritize preparing students for real-world scenarios by evaluating their ability to apply knowledge in authentic, contemporary contexts. These assessments go beyond verifying understanding; they aim to cultivate skills for practical application, adaptability, and readiness for diverse, evolving environments. Assessments in this lane emphasize problem-solving, critical thinking, and collaboration, reflecting the skills needed in modern settings, which may involve interactions with AI or other emerging technologies.

Example

Assignment Title: "Contemporary Policy Analysis"

Lane 1 Component:

Description: Students conduct an in-depth analysis of historical political policies within a specific region or country, focusing on foundational theories, key figures, and historical contexts.
Assessment Type: Research paper or presentation.
Lane 1 Focus: Emphasis on understanding historical policy frameworks, demonstrating knowledge of foundational political theories, and proficiency in academic research and analysis.

Lane 2 Component:

Description: Students apply historical policy insights to propose innovative solutions or amendments to address contemporary socio-political challenges faced by the same region or country.
Assessment Type: Policy proposal or a simulated negotiation role-play.
Lane 2 Focus: Application of historical knowledge to address current socio-political issues, critical thinking, problem-solving, and practical policy-making skills in real-world scenarios.

This assessment integrates Lane 1 by ensuring students comprehend the historical political landscape and theories (focusing on foundational knowledge), while Lane 2 requires them to practically apply this knowledge to propose solutions for current political challenges, fostering skills applicable in real-world scenarios.

Two roads that merge into one.

Image was created using AI

Important note

Assessing learners throughout their learning journey is pivotal for their growth and development. It's not just about a final destination; it's the milestones along the way that truly shape their understanding. For instance, breaking down a major assignment, like a research paper, into smaller milestones allows for continuous feedback and iterative improvement. This approach not only ensures learners stay on track but also grants them opportunities to apply feedback, refine their work, and progressively build upon their understanding. Assessing incrementally fosters a deeper engagement with the material, cultivates a habit of reflection and refinement, and ultimately empowers learners to evolve their skills and knowledge in a more comprehensive and effective manner.

summary

Further resources

What to do about assessments if we can’t out-design or out-run AI?

Visual representation of the Two Lane Approach

Artificial Intelligence Is a Tool for Cheating Academic Integrity

How to cheat on your final paper: Assigning AI for student writing

All work is group work now: Collaborative learning as a pedagogical and assessment framework for learning with generative AI

Harnessing the Power of AI: Transforming Assignments and Assessments in Higher Education