Using Bloom’s Taxonomy we can see that effective human-AI collaboration will largely mean delegating lower-level cognitive tasks so that we can focus our energy on more complex, cognitive tasks. These skills are Analyze, Evaluate and Create tasks, levels of cognition where AI technology currently falls short. ![]() ![]() We value our doctor’s clinical judgment in weighing the benefits and risks of a treatment plan, our lawyer’s ability to synthesize precedent and advocate on our behalf, and a consultant’s ability to identify an out-of-the-box solution no one else thought of. Although AI may excel at Recall and Understand tasks, few people consult their doctor to inventory all possible symptoms of a disease or ask their lawyer to recite case law verbatim or hire a consultant to explain the theory of Porter’s Five Forces.īut we turn to experts for higher-level cognitive tasks. It’s making Google nervous, but I felt better after spending some quality time with it.Īs for our doctor, lawyer, and consultant, Bloom’s Taxonomy also provides a more nuanced view of how AI might someday reshape - not replace - these professions. Opinion Column: I asked ChatGPT to write me a symphony, a letter to an ex and moreĬhatGPT is the most sophisticated chatbot ever released. Thus, Bloom’s Taxonomy allows us to draw more nuanced assessments of the AI technology than raw human versus AI comparison. We are seeing similar behavior for different prompts across these taxonomy levels. It made no quantitative assessment of these risks, did not account for the logistical challenges of cold storage for such an immense quantity and did not warn of the possibility that a vaccine-resistant variant might arise. With the second, however, ChatGPT waffled unconvincingly about having too much or too little vaccine. With the first prompt, ChatGPT responded well by applying and explaining a formula to suggest a reasonable vaccine quantity (albeit making a small arithmetic mistake in the process). ChatGPT generally does well with Recall, Understand and Apply tasks but struggles with the more complex Analyze and Evaluate tasks. Then we compared the quality of the two responses and repeated this exercise for all six levels of the taxonomy. We then modified the question, asking it to “Discuss the pros and cons of ordering 1.8 million vaccines” - an Evaluate level task. How much should we stock to meet 95% of demand?” - an Apply task. My research group has begun assessing ChatGPT through the lens of Bloom’s Taxonomy by asking it to respond to variations on a prompt, each targeting a different level of cognition.įor example, we asked the AI: “Suppose demand for COVID vaccines this winter is forecasted to be 1 million doses plus or minus 300,000 doses. ![]() ![]() We can use it to assess the strengths and limitations of ChatGPT or other AI tools that manipulate images, create audio, or pilot drones. Moreover, Bloom’s Taxonomy isn’t tied to a particular technology - it applies to cognition broadly. These six levels are intuitive, even for non-experts, but specific enough to make meaningful assessments. Its six levels are: 1) Remember - recall basic facts, 2) Understand - explain concepts, 3) Apply - use information in new situations, 4) Analyze - draw connections between ideas, 5) Evaluate - critique or justify a decision or opinion, and 6) Create - produce original work. First published in 1956 and later revised in 2001, Bloom’s Taxonomy is a hierarchy describing levels of thinking in which higher levels represent more complex thought. To meet this need, my research group turned to an old idea from education: Bloom’s Taxonomy.
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |