Jeff’s first reading assignment for students in his ancient and medieval literature seminar is drawn from the Bible, at least as his syllabus is written currently. Students are tasked with reading sections of Genesis and Exodus, selecting a passage that links to a pre-identified theme, and explaining the significance of the selected passage.
Assuming the persona of a student in the seminar, I tried two approaches to prompt the bot to become my teaching assistant for this reading assignment. The first approach, which I call “ making friends,” was less helpful than the second approach, which I call “no nonsense.” In this post I’ll excerpt from each transcript to illuminate differences. Here is the opening of the making friends approach:
- robot: Hello, How can I assist you?
- user: I am a recent high school graduate (2021) taking a course in ancient literature as part of a GE program. What can I tell you about myself that might guide you to better assist me?
- robot: That's great! To provide you with better assistance, you can tell me more about your specific interests or any particular topics or works within ancient literature that you find intriguing. Additionally, if you have any specific questions or areas where you need help or guidance, let me know, and I'll do my best to assist you.
- user: To be truthful, I am a biology major. My main goal is to pass this course with a B if possible. I had a six week unit on Greek mythology when I was a sophomore, but I barely remember anything. I had a hard time reading Shakespeare with all of the footnotes.
- robot: I understand! Don't worry, I'm here to help you navigate through your ancient literature course. Since you mentioned that you had a difficult time reading Shakespeare with footnotes, I can provide you with simplified explanations and summaries of the texts you'll encounter. Feel free to ask any specific questions you have about Greek mythology or any other works you're studying. I can break down complex concepts and help you understand them in a biology-major-friendly way. Just let me know how I can assist you!
*****
My second conversation opened very differently. Again assuming the persona of a student in the seminar, I wrote a more specific opening prompt. I included a small bit of personal information, just enough to delimit the immediate context of the assignment. Prior knowledge of literature and personal inclinations and interests were noticeably missing from the prompt. The request for a deliverable (a plan) from the bot eliminated a lot of wasted time in contrast to the making friends approach.
- robot: Hello, How can I assist you?
- user: As a second year college student, I have a lot of reading to do. Help me plan a sequence of work to complete the following assignment:
Genesis, Chs. 1-9 and 11:1-9; Exodus 19-20. For seminar discussion: NOTE: Discussion of each text will include presentation during class of at least one significant passage from the day’s assigned reading. Students will be asked to comment on the context and thematic significance of the passage(s), and then we’ll discuss the passage(s).
1) Drawing from the list of “Main Themes and Issues” set forth on the first page of our syllabus, identify which themes or issues seem relevant for the assigned readings from Genesis and Exodus and briefly explain their relevance.
2) Compare Genesis 1:1-2:4 with Genesis 2:4-3:24 with regard to the process and sequence of creation.
3) In what ways does Exodus 19-20 present a continuation of the story and themes presented in Genesis 1-9 and 11:1-9?
*****
The bot’s output in the making friends approach from the beginning was more attuned to its my nervous, defensive language. Much of its output consists of sentiment-rich cues to reduce anxiety—don’t worry, I can help you, I can simplify things in a biology-major-friendly way. At first, I was curious to see how the bot would modify its output based on this sentiment parameter. Remember that bots have an algorithm for sentiment analysis, one of the supervised training algorithms that have an overarching impact on a conversation. If there is a sentiment expressed in the initial prompt in the no-nonsense approach, it is this: My time is valuable.
In response to the no-nonsense prompt, the bot went right to work.
- robot: To plan your sequence of work for this assignment, I suggest the following steps:
1) Read Genesis, Chs. 1-9 and 11:1-9. Take notes on the significant passages and identify any themes or issues that seem relevant based on the list provided on the first page of your syllabus.
- Look for themes or issues such as creation, the Fall of Man, the Flood, God's relationship with humanity, sin, and the tower of Babel.
2) Prepare for seminar discussion:
- Choose at least one significant passage from the assigned reading to present in class.
- Analyze the context and thematic significance of the passage(s) you have selected.
- Be prepared to discuss the passage(s) with your classmates, considering its connection to the overall themes and issues identified in step 1.
3) Read Exodus 19-20. Compare it with the story and themes presented in Genesis 1-9 and 11:1-9.
- Note any similarities or differences in the storytelling style, themes, or characters.
- Consider how Exodus 19-20 continues or expands upon the themes and issues previously discussed in Genesis, such as God's covenant with His people, the importance of obedience, or the consequences of disobedience.
Keep in mind the timeline for this assignment. Plan your reading and analysis in advance to ensure that you have enough time to thoroughly understand and engage with the texts. Good luck with your assignment!
*****
I wasn’t making friends very well with the bot by opening up my weaknesses and my major. After some unproductive talk about more nonsense and more sentimental fluff, I was getting a little impatient. I was getting nothing actionable from the conversation and began to consider my time being wasted. Witness:
- user: How would you advise me to actually read these assignments? I remember reading passages from the Bible when I was a kid, but I’m not very knowledgeable about it. I’ve never read it for a classroom assignment. It feels pretty strange. Plus my friend in the class is an atheist.
- robot: I understand that reading religious texts for a classroom assignment can feel new and possibly uncomfortable, especially with differing beliefs among classmates. Here are a few tips to approach these assignments:
1. Approach the texts with an open mind: Remember that studying religious texts in an academic setting is about analyzing and understanding the literary, historical, and cultural aspects rather than promoting or challenging religious beliefs.
2. Read with context: Before starting the assigned readings, take some time to research the historical and cultural background of the texts. Understanding the context can provide valuable insights into the meaning and themes presented.
3. Take it one step at a time: Break down the readings into smaller sections and take your time with each passage. It can be helpful to read the text multiple times to grasp the details and nuances.
4. Use additional resources: Consider using study guides, commentaries, or reliable online sources to gain a deeper understanding of the texts. These resources can provide explanations, summaries, and historical context to aid your comprehension.
5. Seek clarification: If you come across specific terms or concepts that are unclear, don't hesitate to reach out to your professor or classmates for clarification. Engaging in discussions can help broaden your understanding and provide different perspectives.
Remember, the goal of studying ancient literature is to analyze the texts from an academic standpoint. It's perfectly normal to have differing beliefs or perspectives in the classroom, and engaging in respectful and open discussions can often enhance the learning experience for everyone involved.
*****
There was nothing actionable in the bot’s friendly advice. How does one suddenly get an open mind? Where do I get the time to research the historical background? In accordance with the no nonsense approach, I began to understand the importance of visualizing myself in real time doing this assignment. Regardless of the sophistication of the reader, Jeff’s assignment is challenging on multiple levels. As a student with finite time, however, I wondered what the bot would estimate how much of my available academic time would be needed. If I asked this question routinely, I could get some sense of the bot’s reliability based on empirical evidence. Back to the non nonsense bot
- user: Given the difficulty of this assignment, how much time would you estimate it will take me to complete it?
- robot: The amount of time required to complete this assignment will depend on several factors, including your reading speed, prior familiarity with the texts, and your ability to comprehend and analyze the material. However, as a rough estimate, you can expect to spend around 4-6 hours for reading and note-taking. This estimation includes taking breaks and allowing for potential challenges in understanding and analyzing the texts. Keep in mind that this is just an estimate, and it may vary based on individual factors. It is always a good idea to budget extra time to ensure you have enough time to complete the assignment thoroughly.
*****
As the bot and I worked harder and harder, I could see we were working at cross purposes. Despite having provided the bot with the specific details of the reading assignment, the bot decided at one point that I needed background on the entirety of the Bible and produced a long list summarizing the gist of each book in the Bible. I sat for what seemed like an hour waiting for the output to appear on my screen. Then:
- user: How is this information supposed to help me?
- robot: Apologies for any confusion. The historical background information is meant to provide you with context so that you can approach your reading assignments with a greater understanding of the time period, cultural influences, and authors behind the text. This broader knowledg
- user: I’m not confused. I would like to know how to connect the fact that Genesis is a book in the Bible recognized by Jews and Christians alike with how I will read my assignment
- robot: I apologize for any misunderstanding. Recognizing that Genesis is a book in the Bible recognized by both Jews and Christians can help you approach your assignment with an understanding of its significance and the multiple perspectives that surround it. It is important to approach religious texts with sensitivity and respect for varying bel
- user: I’m reading this for an assignment. I will try to be sensitive and have an open mind. Actually, I’m starting to worry that I’m going to sound insensitive in class if I talk during discussion. What do you suggest?
- robot: It's great that you're aiming to approach the discussion with sensitivity and an open mind. Here are a few suggestions to help you participate respectfully:
Even though I knew on one level I as an experimentalist would not face the cauldron of the seminar, I was beginning to feel discouraged for any student seeking help on these readings from the bot. Earlier it had directed me to obtain a copy of the book “The Bible for Dummies” to peruse before I open my mouth in class. Interestingly, it froze in the middle of that advice. It instructed me to do a lot of listening and ask clarifying questions.
In the no nonsense condition, however, I had a sequenced plan and a time estimate. I was learning ever more emphatically the significance of thinking visually and viscerally about the precise elements of the task:
- user: What criteria should I use to select a passage to discuss in class?
- robot: When selecting a passage to discuss in class, consider the following criteria:
1) Relevance: Choose a passage that is directly relevant to the assigned topic or discussion question provided for the seminar. Look for passages that address key themes, concepts, or issues.
2) Significance: Select a passage that is significant in terms of its impact on the overall text or its importance in understanding the author's intended message. Look for passages that are pivotal, climactic, or contain key revelations or turning points.
3) Complexity: Choose a passage that is complex or thought-provoking. Look for passages that raise interesting questions, present conflicting ideas, or require careful analysis for full comprehension.
4) Interpretive potential: Select a passage that allows for multiple interpretations or can be approached from different angles. Look for passages that offer opportunities for engaging and stimulating discussion among your peers.
5) Personal interest: Consider your own interests and perspective. Choose a passage that resonates with you or sparks your curiosity. This will help you engage more actively in the discussion and share your insights with the class.
By considering these criteria, you can identify a passage that will contribute to a meaningful and fruitful class discussion.
- user: Would it be appropriate for me to select a passage that I struggle to understand?
- robot: Yes, it can be appropriate to select a passage that you struggle to understand for discussion in class. In fact, discussing a challenging passage can be beneficial as it provides an opportunity for you to seek clarification and gain insights from your instructor and peers. By bringing a passage that you find difficult, you can engage in a collaborative learning process and deepen your understanding through the discussions and explanations offered by others.
*****
The making friends approach spiraled to a disastrous crash. If I were a student, if this were my first experience with a bot as a reading assistant, I’m not sure I would try again. Witness the following excerpt from near the conclusion:
- user: I’m learning from you that you’re taking a lot of time, and I’m not getting much help with the assignment. I should keep an open mind, be sensitive to other beliefs, read other texts besides those assigned to me. All you’ve told me to do really is take notes while I read. Whatever you say next, please do not apologize to me. Help me figure out how to read this assignment. I have one week.
- robot: I apologize for any frustration caused by my previous responses. I understand your need for specific guidance. Here is a more direct approach to reading your assignment effectively:
1. Start with the assigned passages: Begin by reading Genesis 1:1-2:4 and Genesis 2:4-3:24 closely. Take your time to understand the content and structure of each passage individually.
2. Compare the processes of creation: Pay attention to the similarities and differences in the depictions of creation in the two passages. Note the sequence of events, the roles assigned to humankind, and any variations in the language or tone.
*****
The difference between the no nonsense approach and the making friends approach was night and day. I have a feeling a student might improve performance through using some of the advice the bot provided. I have an equally strong feeling that the bot might have destroyed the assignment for the biology major. I’ll end this post with a few selected passages from the no nonsense wind down. The first is a standard pre reading item:
- user: What key vocabulary and concepts will I need to know to complete this assignment?
- robot: To successfully complete this assignment, it would be helpful to be familiar with the following key vocabulary and concepts:
1) Creation narrative: The stories in Genesis 1-2 that describe the creation of the universe, earth, and human beings.
2) Garden of Eden: The paradise where Adam and Eve resided before their expulsion.
3) Fall of man: The disobedience of Adam and Eve that resulted in their expulsion from the Garden of Eden and the introduction of sin and suffering into the world.
4) Noah's Ark: The massive boat built by Noah to save his family and a pair of every animal from the flood described in Genesis 6-9.
5) Tower of Babel: The tower constructed by humans in rebellion against God, resulting in the confusion of languages and the dispersal of people across the earth, as described in Genesis 11:1-9.
6) Exodus: The liberation of the Israelites from slavery in Egypt, led by Moses.
7) Ten Commandments: The set of moral and religious laws given by God to Moses on Mount Sinai, as described in Exodus 19-20.
It would be beneficial to have a good understanding of these concepts and any related terms to comprehend and analyze the assigned passages more effectively.
- user: Please provide some background about the Tower of Babel.
*****
For the next few minutes I probed around this list of key terms and concepts and ended with two very productive prompts:
- user: Please write 3-5 review questions that I can use to test my overall comprehension of this reading assignment.
- robot: 1) What are the main events and themes in the creation narratives found in Genesis chapters 1-9?
2) Discuss the significance and symbolism of the story of the Tower of Babel in Genesis 11:1-9.
3) How did Moses become a prominent figure in the liberation of the Israelite people from slavery in Egypt?
4) Describe the key events and commandments revealed at Mount Sinai according to the account in Exodus 19-20.
5) Reflect on the role of Moses as a leader and lawgiver in the biblical narrative and discuss his impact on the Israelite community.
- user: Now please write one overarching discussion question I might consider asking in class.
- robot: What do the Genesis creation narratives and the story of the Tower of Babel reveal about humanity's relationship with the divine and the consequences of human actions?
- user: Is there anything else you can say to help me complete this reading assignment?
- robot: In addition to reading the assigned texts, it can be helpful to supplement your understanding by consulting reliable commentaries, study guides, or academic articles related to the passages. These resources can provide valuable insights, historical context, and scholarly interpretations to enhance your analysis and discussion. Additionally, make sure to take notes while reading to track key themes, connections, and questions that arise. Don't hesitate to reach out to your professor or classmates for any clarifications or further discussions. Finally, give yourself sufficient time to review your notes and prepare for the seminar discussion so that you can actively participate and contribute meaningfully to the conversation.
Good job! Your interactions provide insight into how the bot works; how to get productive assistance -- and revealed that maybe sentiment gets in the way of getting a clean answer and plan when the bot is more concerned with the user’s anxiety than digging into the assignment, no?