formula for 5 paragraph essay

• PRO Courses Guides New Tech Help Pro Expert Videos About wikiHow Pro Upgrade Sign In
• EDIT Edit this Article
• EXPLORE Tech Help Pro About Us Random Article Quizzes Request a New Article Community Dashboard This Or That Game Popular Categories Arts and Entertainment Artwork Books Movies Computers and Electronics Computers Phone Skills Technology Hacks Health Men's Health Mental Health Women's Health Relationships Dating Love Relationship Issues Hobbies and Crafts Crafts Drawing Games Education & Communication Communication Skills Personal Development Studying Personal Care and Style Fashion Hair Care Personal Hygiene Youth Personal Care School Stuff Dating All Categories Arts and Entertainment Finance and Business Home and Garden Relationship Quizzes Cars & Other Vehicles Food and Entertaining Personal Care and Style Sports and Fitness Computers and Electronics Health Pets and Animals Travel Education & Communication Hobbies and Crafts Philosophy and Religion Work World Family Life Holidays and Traditions Relationships Youth
• Browse Articles
• Learn Something New
• Quizzes Hot
• This Or That Game
• Train Your Brain
• Explore More
• Support wikiHow
• About wikiHow
• Log in / Sign up
• Education and Communications
• College University and Postgraduate
• Academic Writing

How to Write a Five Paragraph Essay

Last Updated: April 4, 2024 Fact Checked

This article was co-authored by Jake Adams and by wikiHow staff writer, Danielle Blinka, MA, MPA . Jake Adams is an academic tutor and the owner of Simplifi EDU, a Santa Monica, California based online tutoring business offering learning resources and online tutors for academic subjects K-College, SAT & ACT prep, and college admissions applications. With over 14 years of professional tutoring experience, Jake is dedicated to providing his clients the very best online tutoring experience and access to a network of excellent undergraduate and graduate-level tutors from top colleges all over the nation. Jake holds a BS in International Business and Marketing from Pepperdine University. There are 8 references cited in this article, which can be found at the bottom of the page. This article has been fact-checked, ensuring the accuracy of any cited facts and confirming the authority of its sources. This article has been viewed 525,621 times.

Five paragraph essays are a common assignment throughout your school career, especially in high school and college. Since any subject can include a five paragraph essay, you’ll want to be good at writing them. Luckily, five-paragraph essays are really easy to write if you know the expected format and give yourself the time you need to write it. To write your five paragraph essay, draft your introduction, develop three body paragraphs, write your conclusion, and revise and edit your essay.

Drafting Your Introduction

• For example, you could phrase your hook like this: Nature’s life cycle is often used as a metaphor to convey ideas about the passage of life.
• If you are writing a persuasive essay, don’t include your stance in your hook.
• Don’t say “In this essay” or “I am going to show.” Instead, use the “show, don’t tell” technique using descriptive language.
• It’s often easiest to come up with your hook after you write the rest of your essay. If you’re struggling to come up with one, use a basic placeholder and then create a better hook when you revise your essay.

• Don’t reveal your main points yet.
• For example, you could say something like this: While spring compares with birth, summer can symbolize maturity, with fall and winter showing a descent toward death.

• This sentence depends on what type of paper you’re writing. If it’s an argumentative paper, introduce both sides of the argument. In an informative paper, mention the central idea and focus.
• As an example, you could narrow your topic like this: Writers often use nature metaphors in their work to show themes about life, such as the blossoming of youth.

• For example, your thesis could read like this: In the poem “Raspberries,” the author shows youth through the ripening berries, summer blossoming, and blushing color of the fruit.
• Each of the three examples provided in the thesis will become the topic of a body paragraph. For the example thesis, you would have body paragraphs about ripening berries, summer blossoming, and the blushing color of the fruit.

Developing Three Body Paragraphs

• You should include three body paragraphs, one for each supporting point.

• Your topic sentence is like a mini-thesis for just that paragraph.
• Use a quote related to your thesis and analyze it in the body paragraph. If you use a topic sentence, put the quote next.
• For example, your topic sentence could look like this: Ripening berries show youth in the poem “Raspberries” by reaching maturity and becoming ready for picking.

• Each paragraph should contain two to three examples or pieces of evidence.
• If you use research, cite your sources in the appropriate format that your instructor specifies.

• Include two to three sentences of commentary for each example or piece of evidence.
• Depending on the type of evidence or examples, it’s often best to alternate your evidence and commentary throughout the paragraph. For example, provide one example, then provide the commentary.

• For example, you could wrap up your paragraph like this: As the girl plucks the ripe raspberries from the bush and eats them, her actions represent her own youth and readiness to be “plucked” by someone.

Drafting Your Conclusion

• For example, you could restate your thesis like this: The poem “Raspberries” provides an allegorical representation of youth through a metaphor of ripening berries, summer blossoming, and blushing color of the fruit.
• If you're a beginning writer, it's okay to start your conclusion with "In conclusion." However, if you're an advanced writer, avoid starting your conclusion with statements like “In conclusion,” “To conclude,” or “In the end.”

• Use an authoritative tone as you restate your arguments so that your reader walks away knowing that you are correct.

• Include a call to action.
• Provide a warning about what could happen if your stance is ignored.
• Create an image in the reader’s mind.
• Include a quote.
• Make a universal statement about life.

Revising and Editing Your Essay

• Always reread your sentence to make sure that the word processor is suggesting the right word. If you’ve misspelled a word that is similar to another word, then it’s possible that your spell check could suggest the wrong spelling, such as “then” instead of “than.”

• Look for errors that your spell checker missed.
• If you can, ask someone else to proofread your paper. They will usually spot errors that you overlooked.

• Combine choppy sentences.
• Breakup long, convoluted sentences into shorter sentences.
• Rewrite fragments and run-on sentences.

• If you have cited sources, make sure that you include a reference page in the style chosen by your instructor.

Expert Q&A

• Never plagiarize an essay, which means copying someone’s work or ideas without giving them credit. Your teacher will deny you credit for the essay, and you may also get a discipline consequence. Thanks Helpful 0 Not Helpful 1

You Might Also Like

• ↑ Jake Adams. Academic Tutor & Test Prep Specialist. Expert Interview. 20 May 2020.
• ↑ https://www.grammarly.com/blog/five-paragraph-essay/
• ↑ https://writingcenter.unc.edu/tips-and-tools/college-writing/
• ↑ https://www.bucks.edu/media/bcccmedialibrary/pdf/FiveParagraphEssayOutlineJuly08_000.pdf
• ↑ https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4789530/
• ↑ https://writingcenter.fas.harvard.edu/pages/ending-essay-conclusions
• ↑ https://owl.purdue.edu/owl/general_writing/the_writing_process/proofreading/proofreading_suggestions.html
• ↑ https://owl.purdue.edu/owl/general_writing/the_writing_process/proofreading/steps_for_revising.html

About This Article

To write a five paragraph essay, start with an introductory paragraph that includes a hook to capture your audience’s attention, and a thesis that explains the main point you’re trying to make. Then, use the next 3 paragraphs to explain 3 separate points that support your thesis. As you explain each point, use evidence from your research or examples in the text you’re discussing. Finally, conclude your essay with a paragraph summing up the points you’ve made and telling the reader how those points support your thesis. For tips on how to revise your essay to improve the flow and formatting, read on! Did this summary help you? Yes No

• Send fan mail to authors

Reader Success Stories

Mohamed Abdou

Nov 3, 2017

Did this article help you?

Suzanne Carlson

Jul 20, 2020

Hunter Fleming

Feb 16, 2017

Oct 6, 2016

Dave Seville

Mar 24, 2017

Featured Articles

Trending Articles

Watch Articles

• Terms of Use
• Privacy Policy
• Do Not Sell or Share My Info
• Not Selling Info

Get all the best how-tos!

Sign up for wikiHow's weekly email newsletter

• U.S. Locations
• UMGC Europe
• Learn Online
• Find Answers
• 855-655-8682
• Current Students

UMGC Effective Writing Center Secrets of the Five-Paragraph Essay

Explore more of umgc.

• Writing Resources

This form of writing goes by different names. Maybe you've heard some of them before: "The Basic Essay," "The Academic Response Essay," "The 1-3-1 Essay." Regardless of what you've heard, the name you should remember is "The Easy Essay."

Once you are shown how this works--and it only takes a few minutes--you will have in your hands the secret to writing well on almost any academic assignment. Here is how it goes.

Secret #1—The Magic of Three

Three has always been a magic number for humans, from fairy tales like "The Three Little Pigs" to sayings like “third time’s a charm.” Three seems to be an ideal number for us--including the academic essay. So whenever you are given a topic to write about, a good place to begin is with a list of three. Here are some examples (three of them, of course):

Topic : What are the essential characteristics of a good parent? Think in threes and you might come up with:

• unconditional love 

Certainly, there are more characteristics of good parents you could name, but for our essay, we will work in threes.

Here's a topic that deals with a controversial issue:

Topic : Should women in the military be given frontline combat duties?

• The first reason that women should be assigned to combat is equality. 
• The second reason is their great teamwork. 
• The third reason is their courage.

As you see, regardless of the topic, we can list three points about it. And if you wonder about the repetition of words and structure when stating the three points, in this case, repetition is a good thing. Words that seem redundant when close together in an outline will be separated by the actual paragraphs of your essay. So in the essay instead of seeming redundant they will be welcome as signals to the reader of your essay’s main parts.

Finally, when the topic is an academic one, your first goal is the same: create a list of three.

Topic: Why do so many students fail to complete their college degree?

• First, students often...
• Second, many students cannot...
• Finally, students find that...

Regardless of the reasons you might come up with to finish these sentences, the formula is still the same.

Secret #2: The Thesis Formula

Now with your list of three, you can write the sentence that every essay must have—the thesis, sometimes called the "controlling idea," "overall point," or "position statement." In other words, it is the main idea of the essay that you will try to support, illustrate, or corroborate.

Here’s a simple formula for a thesis: The topic + your position on the topic = your thesis.

Let’s apply this formula to one of our examples:

Topic: Essential characteristics of a good parent Your Position: patience, respect, love Thesis: The essential characteristics of a good parent are patience, respect, and love.

As you see, all we did was combine the topic with our position/opinion on it into a single sentence to produce the thesis: The essential characteristics of a good parent are patience, respect, and love.

In this case, we chose to list three main points as part of our thesis. Sometimes that’s a good strategy. However, you can summarize them if you wish, as in this example:

Topic: Women in combat duty in the military Your Position: They deserve it Thesis: Women deserve to be assigned combat duty in the military.

This type of thesis is shorter and easier to write because it provides the overall position or opinion without forcing you to list the support for it in the thesis, which can get awkward and take away from your strong position statement. The three reasons women deserve to be assigned combat duties--equality, teamwork, courage--will be the subjects of your three body paragraphs and do not need to be mentioned until the body paragraph in which they appear.

Secret #3: The 1-3-1 Outline

With your thesis and list of three main points, you can quickly draw a basic outline of the paragraphs of your essay. You’ll then see why this is often called the 1-3-1 essay.

• Supporting Evidence for Claim 1    
• Supporting Evidence for Claim 2
• Supporting Evidence for Claim 3

The five-paragraph essay consists of one introduction paragraph (with the thesis at its end), three body paragraphs (each beginning with one of three main points) and one last paragraph—the conclusion. 1-3-1.

Once you have this outline, you have the basic template for most academic writing. Most of all, you have an organized way to approach virtually any topic you are assigned.

Our helpful admissions advisors can help you choose an academic program to fit your career goals, estimate your transfer credits, and develop a plan for your education costs that fits your budget. If you’re a current UMGC student, please visit the Help Center .

Personal Information

Contact information, additional information.

By submitting this form, you acknowledge that you intend to sign this form electronically and that your electronic signature is the equivalent of a handwritten signature, with all the same legal and binding effect. You are giving your express written consent without obligation for UMGC to contact you regarding our educational programs and services using e-mail, phone, or text, including automated technology for calls and/or texts to the mobile number(s) provided. For more details, including how to opt out, read our privacy policy or contact an admissions advisor .

Please wait, your form is being submitted.

By using our website you agree to our use of cookies. Learn more about how we use cookies by reading our  Privacy Policy .

The Ultimate Guide to the 5-Paragraph Essay

PeopleImages / Getty Images

• M.Ed., Education Administration, University of Georgia
• B.A., History, Armstrong State University

A five-paragraph essay is a prose composition that follows a prescribed format of an introductory paragraph, three body paragraphs, and a concluding paragraph, and is typically taught during primary English education and applied on standardized testing throughout schooling.

Learning to write a high-quality five-paragraph essay is an essential skill for students in early English classes as it allows them to express certain ideas, claims, or concepts in an organized manner, complete with evidence that supports each of these notions. Later, though, students may decide to stray from the standard five-paragraph format and venture into writing an  exploratory essay  instead.

Still, teaching students to organize essays into the five-paragraph format is an easy way to introduce them to writing literary criticism, which will be tested time and again throughout their primary, secondary, and further education.

Writing a Good Introduction

The introduction is the first paragraph in your essay, and it should accomplish a few specific goals: capture the reader's interest, introduce the topic, and make a claim or express an opinion in a thesis statement.

It's a good idea to start your essay with a hook (fascinating statement) to pique the reader's interest, though this can also be accomplished by using descriptive words, an anecdote, an intriguing question, or an interesting fact. Students can practice with creative writing prompts to get some ideas for interesting ways to start an essay.

The next few sentences should explain your first statement, and prepare the reader for your thesis statement, which is typically the last sentence in the introduction. Your  thesis sentence  should provide your specific assertion and convey a clear point of view, which is typically divided into three distinct arguments that support this assertation, which will each serve as central themes for the body paragraphs.

Writing Body Paragraphs

The body of the essay will include three body paragraphs in a five-paragraph essay format, each limited to one main idea that supports your thesis.

To correctly write each of these three body paragraphs, you should state your supporting idea, your topic sentence, then back it up with two or three sentences of evidence. Use examples that validate the claim before concluding the paragraph and using transition words to lead to the paragraph that follows — meaning that all of your body paragraphs should follow the pattern of "statement, supporting ideas, transition statement."

Words to use as you transition from one paragraph to another include: moreover, in fact, on the whole, furthermore, as a result, simply put, for this reason, similarly, likewise, it follows that, naturally, by comparison, surely, and yet.

Writing a Conclusion

The final paragraph will summarize your main points and re-assert your main claim (from your thesis sentence). It should point out your main points, but should not repeat specific examples, and should, as always, leave a lasting impression on the reader.

The first sentence of the conclusion, therefore, should be used to restate the supporting claims argued in the body paragraphs as they relate to the thesis statement, then the next few sentences should be used to explain how the essay's main points can lead outward, perhaps to further thought on the topic. Ending the conclusion with a question, anecdote, or final pondering is a great way to leave a lasting impact.

Once you complete the first draft of your essay, it's a good idea to re-visit the thesis statement in your first paragraph. Read your essay to see if it flows well, and you might find that the supporting paragraphs are strong, but they don't address the exact focus of your thesis. Simply re-write your thesis sentence to fit your body and summary more exactly, and adjust the conclusion to wrap it all up nicely.

Practice Writing a Five-Paragraph Essay

Students can use the following steps to write a standard essay on any given topic. First, choose a topic, or ask your students to choose their topic, then allow them to form a basic five-paragraph by following these steps:

• Decide on your  basic thesis , your idea of a topic to discuss.
• Decide on three pieces of supporting evidence you will use to prove your thesis.
• Write an introductory paragraph, including your thesis and evidence (in order of strength).
• Write your first body paragraph, starting with restating your thesis and focusing on your first piece of supporting evidence.
• End your first paragraph with a transitional sentence that leads to the next body paragraph.
• Write paragraph two of the body focussing on your second piece of evidence. Once again make the connection between your thesis and this piece of evidence.
• End your second paragraph with a transitional sentence that leads to paragraph number three.
• Repeat step 6 using your third piece of evidence.
• Begin your concluding paragraph by restating your thesis. Include the three points you've used to prove your thesis.
• End with a punch, a question, an anecdote, or an entertaining thought that will stay with the reader.

Once a student can master these 10 simple steps, writing a basic five-paragraph essay will be a piece of cake, so long as the student does so correctly and includes enough supporting information in each paragraph that all relate to the same centralized main idea, the thesis of the essay.

Limitations of the Five-Paragraph Essay

The five-paragraph essay is merely a starting point for students hoping to express their ideas in academic writing; there are some other forms and styles of writing that students should use to express their vocabulary in the written form.

According to Tory Young's "Studying English Literature: A Practical Guide":

"Although school students in the U.S. are examined on their ability to write a  five-paragraph essay , its  raison d'être  is purportedly to give practice in basic writing skills that will lead to future success in more varied forms. Detractors feel, however, that writing to rule in this way is more likely to discourage imaginative writing and thinking than enable it. . . . The five-paragraph essay is less aware of its  audience  and sets out only to present information, an account or a kind of story rather than explicitly to persuade the reader."

Students should instead be asked to write other forms, such as journal entries, blog posts, reviews of goods or services, multi-paragraph research papers, and freeform expository writing around a central theme. Although five-paragraph essays are the golden rule when writing for standardized tests, experimentation with expression should be encouraged throughout primary schooling to bolster students' abilities to utilize the English language fully.

• 100 Persuasive Essay Topics
• Examples of Great Introductory Paragraphs
• How To Write an Essay
• How to Write a Great Essay for the TOEFL or TOEIC
• How to Write and Format an MBA Essay
• Write an Attention-Grabbing Opening Sentence for an Essay
• How to Structure an Essay
• How to Help Your 4th Grader Write a Biography
• Definition and Examples of Body Paragraphs in Composition
• What Is Expository Writing?
• Paragraph Writing
• 3 Changes That Will Take Your Essay From Good To Great
• What an Essay Is and How to Write One
• An Introduction to Academic Writing
• Tips on How to Write an Argumentative Essay
• Definition and Examples of Analysis in Composition

How to write a perfect 5 Paragraph Essay

  How to Write a 5 Paragraph Essay : A Complete Guide

Essay writing can be the bane of many a student’s life.

Gone are the days when many students tried writing in big letters to fill the allotted number of pages with minimal effort quickly.

Now, it’s all constant word count checks and taking a dozen words to say what could be said in three.

Of course, it doesn’t have to be like this. When students have a clear, set structure to follow, essay writing can be a much less painful experience. Indeed, it can even be enjoyable!

In this article, we’ll outline a clear template our students can follow to produce a well-organised essay on practically any topic effectively.

Let’s get started!

THE HAMBURGER ESSAY – THE STUDENT’S FRIEND

The common 5 paragraph essay structure is often referred to as the hamburger essay . And this is a memorable way to communicate the concept to your students.

The hamburger essay structure consists of five paragraphs or layers as follows:

Layer 1 – The Top Bun: The Introduction

The uppermost layer is the introductory paragraph which communicates to the reader the purpose of the essay.

Layers 2,3, & 4 – The Meat Patties: The Body Paragraphs

These are the meat patties of the essay and each paragraph makes an argument in support of the essay’s central contention as expressed in the introduction.

Layer 5 – The Conclusion: The Bottom Bun

The bottommost layer is the conclusion, where the arguments are summed up and the central contention of the essay is restated forcefully one last time. We have a complete guide to writing a conclusion here .

Soon, we’ll take a closer look at each of these parts in turn. But, there is more to an essay than just the writing of it. There are also the prewriting and post writing stages to consider. We will look at all these aspects in this article, but first, let’s examine what our students need to be doing before they even begin to write their essays.

A COMPLETE UNIT ON TEACHING PARAGRAPH WRITING

This complete PARAGRAPH WRITING UNIT takes students from zero to hero over FIVE STRATEGIC LESSONS to improve PARAGRAPH WRITING SKILLS through PROVEN TEACHING STRATEGIES.

THE PREWRITING STAGE – DEFINING THE THESIS STATEMENT, RESEARCH & PLANNING

The thesis statement.

Every essay needs a clear focus. This focus is usually defined in a thesis statement that presents the topic of the essay in a sentence or two. The thesis statement should also include the writer’s stance on that topic.

As this will help guide the direction of the essay, it is essential that our students define their thesis statement before they begin the writing process.

Sometimes during the process of writing, we find out what we think about a given topic. The writing process can act as a kind of reflection on the merits of the various arguments, before finally revealing to us our own opinion. This is writing as a method of discovery.

Usually, though, it is more efficient for students to decide on their opinions prior to beginning to write.

Defining their thesis statement early on not only helps guide the students writing, but helps ensure their research is focused and efficient at the crucial prewriting stage.

Research & Planning

As students begin their research and gather their evidence to support their thesis statement, they should also be encouraged to pay particular attention to the counterarguments they come across.

A well-written essay does not ignore opposing viewpoints, students should be taught to preempt counterarguments where possible so as to strengthen the power of their own arguments. Good research is essential for this.

Not so long ago, research meant hours in dusty libraries being constantly shushed, but with the advent of the internet, there is now a wealth of knowledge right at our fingertips (and the end of a good Wifi connection).

While this has made research a much more convenient process, students need to be reminded of the importance of seeking out reliable sources to support their opinions. In an era of ‘fake news’, this is more important now than ever.

As students gather the information and supporting evidence for their essay, they’ll need to organize it carefully. Graphic organizers are an effective way of doing this, either on a paper printout or by using a premade template on the computer.

It can also be helpful for students to sort their collected information according to where they intend to use it in the five-paragraph outline or layers mentioned above.

Finally, while good research, organization, and planning are essential for producing a well-written essay, it’s important that students are reminded that essay writing is also a creative act.

Students should maintain an open mind when it comes to the writing process. They should allow their thoughts and opinions the room to develop over the course of writing their essay. They should leave the door open for including new thoughts and ideas as the writing progresses.

The Writing Stage: Introduction, Body Paragraphs, & Conclusion 

The introduction.

A good introduction paragraph serves a number of important functions. It:

• Grabs the reader’s attention and interest, known as the hook
• Orientates the reader to the essays central argument, the thesis statement
• Outlines briefly the arguments that will be explored in support of the thesis statement.

To become an effective writer, it is important that our students learn the importance of grabbing the reader’s attention, as well as keeping it. Opening with a ‘hook’ or a ‘grabber’ is a great way to achieve this.

There are a number of techniques students can use here. Let’s take a look at some of the more common ones.

• The Surprising Fact – this can intrigue the reader to want to find out more, especially if it challenges some of their existing assumptions on a topic.
• The Quotation – a carefully selected quotation can be a great way to secure the reader’s attention and there are many curated quotation collections freely available online to help get students started.
• The Joke – this opening should be used judiciously as for some topics it may not be an appropriate way to open. In the right context however, humor can be a great way to engage the reader from the outset.
• The Anecdote – anecdotes are a great way to personally connect with the essay’s topic. They are a helpful way of climbing down the ladder of abstraction when exploring more theoretical arguments. They assist the reader in relating universal themes to their own lives.

Practice Activity 1:

To encourage students to develop strong opening paragraphs in their essays, it can be helpful to isolate writing opening paragraphs.

In this activity, provide your students with a list of essay topics and challenge them to write four different opening paragraphs for their essay, one each for The Surprising Fact , The Quotation , The Joke , and The Anecdote as listed above.

When students have completed their four paragraphs, they can then share with each other in groups and discuss which worked best and why.

This activity will help students to remember the different types of opening and how they work. It will also give them a feel for which openings work best for different types of essays.

We’ve already discussed what a thesis statement is and what it is intended to achieve, but where does it fit into the overall shape of the introductory paragraph exactly?

While there are no hard and fast rules here, thesis statements work well towards the end of the introductory paragraph – especially as the paragraph’s final sentence.

Readers are often hardwired to look for the thesis statement there. It connects the arguments that follow in the body paragraphs to the preceding sentences and contextualizes the essay for the reader.

THE BODY PARAGRAPHS

Now we get to the ‘meat’ of our essay. Each of the body paragraphs will explore one of the arguments supporting the thesis statement as laid out in the introduction.

While we are focused on the 5 paragraph essay here, longer essays will usually be constructed in exactly the same manner, they’ll just include more body paragraphs to cover the extra level of detail.

Generally, each body paragraph will open by stating the argument, with subsequent sentences supporting that argument by providing evidence along with some further explanation. Finally, a statement or phrase will help transition to the next paragraph.

The PEEL Paragraph Writing Process

The acronym PEEL can be a very useful tool to help students to understand how to organize each of their body paragraphs.

P oint : start the paragraph by expressing the central argument

E vidence : support the central argument of the paragraph by providing evidence or reasons. Evidence may come in many forms including facts and statistics, quotations from a text or other authority, reference to historical events etc.

E xplanation : explain how the evidence provided supports the paragraph’s central argument.

L ink : provide a transition into the next paragraph by linking this argument and the central thesis to the next point to be made.

Practice Activity 2:

Just as students isolated the opening to their introductory paragraph for practice purposes, in this activity they’ll isolate a single argument on a chosen essay topic.

When they have chosen a topic and selected a single argument related to that topic, they can begin to write one body paragraph using the PEEL structure outlined above.

This activity works well when several students write on the same argument. When each has completed their paragraphs, they can then compare the results with each other.

It can be a fascinating experiment that allows the students to see just how diverse different treatments of the same argument using the same PEEL formula can be – there is freedom within the discipline of the structure!

THE CONCLUSION

The purpose of the conclusion is to close the circle of the essay. It is a chance for the writer to restate the thesis statement, summarize the main arguments, and tie up any loose ends as the writer drives home their point one last time.

At this stage of the game, no new arguments should be introduced. However, students should revisit the previous arguments made in the body paragraphs and it is acceptable to offer up a new insight or two on these.

The student should take care here to make sure they leave no doubt in the reader’s mind that the essay question is fully answered. One useful way of doing this is by incorporating words and phrases from the essay question into the conclusion itself.

To help students grasp the underlying structure of a concluding paragraph, the following sequential structure is useful to keep in mind:

• Starts with a closing phrase such as In conclusion , There is no doubt , Finally etc
• Restates the main thesis statement
• Summarizes the main point of each of the body paragraphs
• Leaves the reader with something to think about.

Practice Activity 3:

Again, here we will isolate the concluding paragraph for focused practice.

Students select a topic they know well, decide what they think about that topic, write down a few key arguments, and then begin writing a concluding paragraph to an essay on that topic.

Students should use the template above to structure that material.

You could also include an element of peer assessment here by having students swap their paragraphs with each other, before offering each other feedback.

The Post Writing Stage: Editing & Proofreading YOUR 5 paragraph ESSAY

The final stage of writing a five-paragraph essay is perhaps the least glamorous of an unglamorous process, but no less essential for it – the editing and proofreading.

Often, our students overlook this stage. After completing the process of research, planning, and writing their five-paragraph essay, they let themselves down at this final, crucial stage.

Frequently, students fail to adequately edit and proofread their work not just because of laziness, but because they are unsure of exactly what this process entails.

To avoid this, ensure students understand that editing and proofreading involve reading through and correcting mistakes in the following areas one after the other:

• Text Organisation: title, headings, layout etc
• Sentence Structure: coherence, grammar , sentence variety etc
• Word Choice: suitable word choices, avoid repetition etc
• Spelling and Punctuation: accuracy in both areas.

Practice Activity 4:

Once students have completed their essays, appoint each a partner to work with and each then edits and proofreads the other person’s work.

Sometimes students struggle to gain the necessary distance from their own work to adequately edit and proofread it, this exercise overcomes that issue while giving them an opportunity to gain some valuable editing and proofreading experience that will benefit them in future.

CLOSING THE CIRCLE

So, there you have it – how to write a five-paragraph essay from start to finish. As with anything, the more practice students get, the quicker they will improve.

But, bear in mind too that writing essays is hard work and you don’t want to put students off.

The best way to provide opportunities for students to develop the various skills related to essay writing is to isolate them in the manner apparent in the activities described above.

This way, students can soon sharpen up their skills, without learning to dread the word ‘essay’ itself!

Teaching Resources

Use our resources and tools to improve your student’s writing skills through proven teaching strategies.

Five Paragraph Essay exampleS (Student Writing Samples)

Below are a collection of student writing samples of 5 paragraph essays.  Click on the image to enlarge and explore them in greater detail.  Please take a moment to both read the 5 paragraph essay in detail but also the teacher and student guides which highlight some of the key elements of this structured model of essay writing here.

Please understand these student writing samples are not intended to be perfect examples for each age or grade level but a piece of writing for students and teachers to explore together to critically analyze to improve student writing skills and deepen their understanding of 5 paragraph essay writing.

We would recommend reading the example either a year above and below, as well as the grade you are currently working with to gain a broader appreciation of this text type.

5 PARAGRAPH ESSAY VIDEO TUTORIALS

Guide on How to Write a 5 Paragraph Essay Effortlessly

Defining What Is a 5 Paragraph Essay

Have you ever been assigned a five-paragraph essay and wondered what exactly it means? Don't worry; we all have been there. A five-paragraph essay is a standard academic writing format consisting of an introduction, three body paragraphs, and a conclusion.

In the introduction, you present your thesis statement, which is the main idea or argument you will discuss in your essay. The three body paragraphs present a separate supporting argument, while the conclusion summarizes the main points and restates the thesis differently.

While the five-paragraph essay is a tried and true format for many academic assignments, it's important to note that it's not the only way to write an essay. In fact, some educators argue that strict adherence to this format can stifle creativity and limit the development of more complex ideas.

However, mastering the five-paragraph essay is a valuable skill for any student, as it teaches the importance of structure and organization in writing. Also, it enables you to communicate your thoughts clearly and eloquently, which is crucial for effective communication in any area. So the next time you're faced with a five-paragraph essay assignment, embrace the challenge and use it as an opportunity to hone your writing skills.

And if you find it difficult to put your ideas into 5 paragraphs, ask our professional service - 'please write my essay ,' or ' write my paragraph ' and consider it done.

How to Write a 5 Paragraph Essay: General Tips

If you are struggling with how to write a 5 paragraph essay, don't worry! It's a common format that many students learn in their academic careers. Here are some tips from our admission essay writing service to help you write a successful five paragraph essay example:

• Start with a strong thesis statement : Among the 5 parts of essay, the thesis statement can be the most important. It presents the major topic you will debate throughout your essay while being explicit and simple.
• Use topic sentences to introduce each paragraph : The major idea you will address in each of the three body paragraphs should be established in a concise subject sentence.
• Use evidence to support your arguments : The evidence you present in your body paragraphs should back up your thesis. This can include facts, statistics, or examples from your research or personal experience.
• Include transitions: Use transitional words and phrases to make the flow of your essay easier. Words like 'although,' 'in addition,' and 'on the other hand' are examples of these.
• Write a strong conclusion: In addition to restating your thesis statement in a new way, your conclusion should highlight the key ideas of your essay. You might also leave the reader with a closing idea or query to reflect on.
• Edit and proofread: When you've completed writing your essay, thoroughly revise and proofread it. Make sure your thoughts are brief and clear and proofread your writing for grammatical and spelling mistakes.

By following these tips, you can write strong and effective five paragraph essays examples that will impress your teacher or professor.

5 Paragraph Essay Format

Let's readdress the five-paragraph essay format and explain it in more detail. So, as already mentioned, it is a widely-used writing structure taught in many schools and universities. A five-paragraph essay comprises an introduction, three body paragraphs, and a conclusion, each playing a significant role in creating a well-structured and coherent essay.

The introduction serves as the opening paragraph of the essay and sets the tone for the entire piece. It should captivate the reader's attention, provide relevant background information, and include a clear and concise thesis statement that presents the primary argument of the essay. For example, if the essay topic is about the benefits of exercise, the introduction may look something like this:

'Regular exercise provides numerous health benefits, including increased energy levels, improved mental health, and reduced risk of chronic diseases.'

The body paragraphs are the meat of the essay and should provide evidence and examples to support the thesis statement. Each body paragraph should begin with a subject sentence that states the major idea of the paragraph. Then, the writer should provide evidence to support the topic sentence. This evidence can be in the form of statistics, facts, or examples. For instance, if the essay is discussing the health benefits of exercise, a body paragraph might look like this:

'One of the key benefits of exercise is improved mental health. Regular exercise has been demonstrated in studies to lessen depressive and anxious symptoms and enhance mood.'

The essay's final paragraph, the conclusion, should repeat the thesis statement and summarize the essay's important ideas. A concluding idea or query might be included to give the reader something to ponder. For example, a conclusion for an essay on the benefits of exercise might look like this:

'In conclusion, exercise provides numerous health benefits, from increased energy levels to reduced risk of chronic diseases. We may enhance both our physical and emotional health and enjoy happier, more satisfying lives by including exercise into our daily routines.'

Overall, the 5 paragraph essay format is useful for organizing thoughts and ideas clearly and concisely. By following this format, writers can present their arguments logically and effectively, which is easy for the reader to follow.

Types of 5 Paragraph Essay 

There are several types of five-paragraph essays, each with a slightly different focus or purpose. Here are some of the most common types of five-paragraph essays:

• Narrative essay : A narrative essay tells a story or recounts a personal experience. It typically includes a clear introductory paragraph, body sections that provide details about the story, and a conclusion that wraps up the narrative.
• Descriptive essay: A descriptive essay uses sensory language to describe a person, place, or thing. It often includes a clear thesis statement that identifies the subject of the description and body paragraphs that provide specific details to support the thesis.
• Expository essay: An expository essay offers details or clarifies a subject. It usually starts with a concise introduction that introduces the subject, is followed by body paragraphs that provide evidence and examples to back up the thesis, and ends with a summary of the key points.
• Persuasive essay: A persuasive essay argues for a particular viewpoint or position. It has a thesis statement that is clear, body paragraphs that give evidence and arguments in favor of it, and a conclusion that summarizes the important ideas and restates the thesis.
• Compare and contrast essay: An essay that compares and contrasts two or more subjects and looks at their similarities and differences. It usually starts out simply by introducing the topics being contrasted or compared, followed by body paragraphs that go into more depth on the similarities and differences, and a concluding paragraph that restates the important points.

Each type of five-paragraph essay has its own unique characteristics and requirements. When unsure how to write five paragraph essay, writers can choose the most appropriate structure for their topic by understanding the differences between these types.

5 Paragraph Essay Example Topics

Here are some potential topics for a 5 paragraph essay example. These essay topics are just a starting point and can be expanded upon to fit a wide range of writing essays and prompts.

• The Impact of Social Media on Teenage Communication Skills.
• How Daily Exercise Benefits Mental and Physical Health.
• The Importance of Learning a Second Language.
• The Effects of Global Warming on Marine Life.
• The Role of Technology in Modern Education.
• The Influence of Music on Youth Culture.
• The Pros and Cons of Uniform Policies in Schools.
• The Significance of Historical Monuments in Cultural Identity.
• The Growing Importance of Cybersecurity.
• The Evolution of the American Dream.
• The Impact of Diet on Cognitive Functioning.
• The Role of Art in Society.
• The Future of Renewable Energy Sources.
• The Effects of Urbanization on Wildlife.
• The Importance of Financial Literacy for Young Adults.
• The Influence of Advertising on Consumer Choices.
• The Role of Books in the Digital Age.\
• The Benefits and Challenges of Space Exploration.
• The Impact of Climate Change on Agriculture.
• The Ethical Implications of Genetic Modification.

Don't Let Essay Writing Stress You Out!

Order a high-quality, custom-written paper from our professional writing service and take the first step towards academic success!

General Grading Rubric for a 5 Paragraph Essay

The following is a general grading rubric that can be used to evaluate a five-paragraph essay:

Content (40%)

• A thesis statement is clear and specific
• The main points are well-developed and supported by evidence
• Ideas are organized logically and coherently
• Evidence and examples are relevant and support the main points
• The essay demonstrates a strong understanding of the topic

Organization (20%)

• The introduction effectively introduces the topic and thesis statement
• Body paragraphs are well-structured and have clear topic sentences
• Transitions between paragraphs are smooth and effective
• The concluding sentence effectively summarizes the main points and restates the thesis statement

Language and Style (20%)

• Writing is clear, concise, and easy to understand
• Language is appropriate for the audience and purpose
• Vocabulary is varied and appropriate
• Grammar, spelling, and punctuation are correct

Critical Thinking (20%)

• Student demonstrate an understanding of the topic beyond surface-level knowledge
• Student present a unique perspective or argument
• Student show evidence of critical thinking and analysis
• Students write well-supported conclusions

Considering the above, the paper should demonstrate a thorough understanding of the topic, clear organization, strong essay writing skills, and critical thinking. By using this grading rubric, the teacher can evaluate the essay holistically and provide detailed feedback to the student on areas of strength and areas for improvement.

Five Paragraph Essay Examples

Wrapping up: things to remember.

In conclusion, writing a five paragraph essay example can seem daunting at first, but it doesn't have to be a difficult task. Following these simple steps and tips, you can break down the process into manageable parts and create a clear, concise, and well-organized essay.

Remember to start with a strong thesis statement, use topic sentences to guide your paragraphs, and provide evidence and analysis to support your ideas. Don't forget to revise and proofread your work to make sure it is error-free and coherent. With time and practice, you'll be able to write a 5 paragraph essay with ease and assurance. Whether you're writing for school, work, or personal projects, these skills will serve you well and help you to communicate your ideas effectively.

Meanwhile, you can save time and reduce the stress associated with academic assignments by trusting our research paper writing services to handle the writing for you. So go ahead, buy an essay , and see how easy it can be to meet all of your professors' complex requirements!

Ready to Take the Stress Out of Essay Writing? 

Order your 5 paragraph essay today and enjoy a high-quality, custom-written paper delivered promptly

is an expert in nursing and healthcare, with a strong background in history, law, and literature. Holding advanced degrees in nursing and public health, his analytical approach and comprehensive knowledge help students navigate complex topics. On EssayPro blog, Adam provides insightful articles on everything from historical analysis to the intricacies of healthcare policies. In his downtime, he enjoys historical documentaries and volunteering at local clinics.

Related Articles

Essay Papers Writing Online

Ultimate guide to writing a five paragraph essay.

Are you struggling with writing essays? Do you find yourself lost in a sea of ideas, unable to structure your thoughts cohesively? The five paragraph essay is a tried-and-true method that can guide you through the writing process with ease. By mastering this format, you can unlock the key to successful and organized writing.

In this article, we will break down the five paragraph essay into easy steps that anyone can follow. From crafting a strong thesis statement to effectively supporting your arguments, we will cover all the essential components of a well-written essay. Whether you are a beginner or a seasoned writer, these tips will help you hone your skills and express your ideas clearly.

Step-by-Step Guide to Mastering the Five Paragraph Essay

Writing a successful five paragraph essay can seem like a daunting task, but with the right approach and strategies, it can become much more manageable. Follow these steps to master the art of writing a powerful five paragraph essay:

• Understand the structure: The five paragraph essay consists of an introduction, three body paragraphs, and a conclusion. Each paragraph serves a specific purpose in conveying your message effectively.
• Brainstorm and plan: Before you start writing, take the time to brainstorm ideas and create an outline. This will help you organize your thoughts and ensure that your essay flows smoothly.
• Write the introduction: Start your essay with a strong hook to grab the reader’s attention. Your introduction should also include a thesis statement, which is the main argument of your essay.
• Develop the body paragraphs: Each body paragraph should focus on a single point that supports your thesis. Use evidence, examples, and analysis to strengthen your argument and make your points clear.
• Conclude effectively: In your conclusion, summarize your main points and restate your thesis in a new way. Leave the reader with a thought-provoking statement or a call to action.

By following these steps and practicing regularly, you can become proficient in writing five paragraph essays that are clear, coherent, and impactful. Remember to revise and edit your work for grammar, punctuation, and clarity to ensure that your essay is polished and professional.

Understanding the Structure of a Five Paragraph Essay

When writing a five paragraph essay, it is important to understand the basic structure that makes up this type of essay. The five paragraph essay consists of an introduction, three body paragraphs, and a conclusion.

Introduction: The introduction is the first paragraph of the essay and sets the tone for the rest of the piece. It should include a hook to grab the reader’s attention, a thesis statement that presents the main idea of the essay, and a brief overview of what will be discussed in the body paragraphs.

Body Paragraphs: The body paragraphs make up the core of the essay and each paragraph should focus on a single point that supports the thesis statement. These paragraphs should include a topic sentence that introduces the main idea, supporting details or evidence, and explanations or analysis of how the evidence supports the thesis.

Conclusion: The conclusion is the final paragraph of the essay and it should summarize the main points discussed in the body paragraphs. It should restate the thesis in different words, and provide a closing thought or reflection on the topic.

By understanding the structure of a five paragraph essay, writers can effectively organize their thoughts and present their ideas in a clear and coherent manner.

Choosing a Strong Thesis Statement

One of the most critical elements of a successful five-paragraph essay is a strong thesis statement. Your thesis statement should clearly and concisely present the main argument or point you will be making in your essay. It serves as the foundation for the entire essay, guiding the reader on what to expect and helping you stay focused throughout your writing.

When choosing a thesis statement, it’s important to make sure it is specific, debatable, and relevant to your topic. Avoid vague statements or generalizations, as they will weaken your argument and fail to provide a clear direction for your essay. Instead, choose a thesis statement that is narrow enough to be effectively supported within the confines of a five-paragraph essay, but broad enough to allow for meaningful discussion.

By choosing a strong thesis statement, you set yourself up for a successful essay that is well-organized, coherent, and persuasive. Take the time to carefully craft your thesis statement, as it will serve as the guiding force behind your entire essay.

Developing Supporting Arguments in Body Paragraphs

When crafting the body paragraphs of your five paragraph essay, it is crucial to develop strong and coherent supporting arguments that back up your thesis statement. Each body paragraph should focus on a single supporting argument that contributes to the overall discussion of your topic.

To effectively develop your supporting arguments, consider using a table to organize your ideas. Start by listing your main argument in the left column, and then provide evidence, examples, and analysis in the right column. This structured approach can help you ensure that each supporting argument is fully developed and logically presented.

Additionally, be sure to use transitional phrases to smoothly connect your supporting arguments within and between paragraphs. Words like “furthermore,” “in addition,” and “on the other hand” can help readers follow your train of thought and understand the progression of your ideas.

Remember, the body paragraphs are where you provide the meat of your argument, so take the time to develop each supporting argument thoroughly and clearly. By presenting compelling evidence and analysis, you can effectively persuade your readers and strengthen the overall impact of your essay.

Polishing Your Writing: Editing and Proofreading Tips

Editing and proofreading are crucial steps in the writing process that can make a significant difference in the clarity and effectiveness of your essay. Here are some tips to help you polish your writing:

1. Take a break before editing: After you finish writing your essay, take a break before starting the editing process. This will help you approach your work with fresh eyes and catch mistakes more easily.

2. Read your essay aloud: Reading your essay aloud can help you identify awkward phrasing, grammar errors, and inconsistencies. This technique can also help you evaluate the flow and coherence of your writing.

3. Use a spelling and grammar checker: Utilize spelling and grammar checkers available in word processing software to catch common errors. However, be mindful that these tools may not catch all mistakes, so it’s essential to manually review your essay as well.

4. Check for coherence and organization: Make sure your ideas flow logically and cohesively throughout your essay. Ensure that each paragraph connects smoothly to the next, and that your arguments are supported by relevant evidence.

5. Look for consistency: Check for consistency in your writing style, tone, and formatting. Ensure that you maintain a consistent voice and perspective throughout your essay to keep your argument coherent.

6. Seek feedback from others: Consider asking a peer, teacher, or tutor to review your essay and provide feedback. External perspectives can help you identify blind spots and areas for improvement in your writing.

7. Proofread carefully: Finally, proofread your essay carefully to catch any remaining errors in spelling, grammar, punctuation, and formatting. Pay attention to details and make any necessary revisions before submitting your final draft.

By following these editing and proofreading tips, you can refine your writing and ensure that your essay is polished and ready for submission.

Tips for Successful Writing: Practice and Feedback

Writing is a skill that improves with practice. The more you write, the better you will become. Set aside time each day to practice writing essays, paragraph by paragraph. This consistent practice will help you develop your writing skills and grow more confident in expressing your ideas.

Seek feedback from your teachers, peers, or mentors. Constructive criticism can help you identify areas for improvement and provide valuable insights into your writing. Take their suggestions into consideration and use them to refine your writing style and structure.

• Set writing goals for yourself and track your progress. Whether it’s completing a certain number of essays in a week or improving your introductions, having specific goals will keep you motivated and focused on your writing development.
• Read widely to expand your vocabulary and expose yourself to different writing styles. The more you read, the more you will learn about effective writing techniques and ways to engage your readers.
• Revise and edit your essays carefully. Pay attention to sentence structure, grammar, punctuation, and spelling. A well-polished essay will demonstrate your attention to detail and dedication to producing high-quality work.

Related Post

How to master the art of writing expository essays and captivate your audience, convenient and reliable source to purchase college essays online, step-by-step guide to crafting a powerful literary analysis essay, unlock success with a comprehensive business research paper example guide, unlock your writing potential with writers college – transform your passion into profession, “unlocking the secrets of academic success – navigating the world of research papers in college”, master the art of sociological expression – elevate your writing skills in sociology.

• school Campus Bookshelves
• menu_book Bookshelves
• perm_media Learning Objects
• login Login
• how_to_reg Request Instructor Account
• hub Instructor Commons

Margin Size

• Download Page (PDF)
• Download Full Book (PDF)
• Periodic Table
• Physics Constants
• Scientific Calculator
• Reference & Cite
• Tools expand_more
• Readability

selected template will load here

This action is not available.

5.1: 5¶E – What is the 5 Paragraph Essay?

• Last updated
• Save as PDF
• Page ID 87134

\( \newcommand{\vecs}[1]{\overset { \scriptstyle \rightharpoonup} {\mathbf{#1}} } \)

\( \newcommand{\vecd}[1]{\overset{-\!-\!\rightharpoonup}{\vphantom{a}\smash {#1}}} \)

\( \newcommand{\id}{\mathrm{id}}\) \( \newcommand{\Span}{\mathrm{span}}\)

( \newcommand{\kernel}{\mathrm{null}\,}\) \( \newcommand{\range}{\mathrm{range}\,}\)

\( \newcommand{\RealPart}{\mathrm{Re}}\) \( \newcommand{\ImaginaryPart}{\mathrm{Im}}\)

\( \newcommand{\Argument}{\mathrm{Arg}}\) \( \newcommand{\norm}[1]{\| #1 \|}\)

\( \newcommand{\inner}[2]{\langle #1, #2 \rangle}\)

\( \newcommand{\Span}{\mathrm{span}}\)

\( \newcommand{\id}{\mathrm{id}}\)

\( \newcommand{\kernel}{\mathrm{null}\,}\)

\( \newcommand{\range}{\mathrm{range}\,}\)

\( \newcommand{\RealPart}{\mathrm{Re}}\)

\( \newcommand{\ImaginaryPart}{\mathrm{Im}}\)

\( \newcommand{\Argument}{\mathrm{Arg}}\)

\( \newcommand{\norm}[1]{\| #1 \|}\)

\( \newcommand{\Span}{\mathrm{span}}\) \( \newcommand{\AA}{\unicode[.8,0]{x212B}}\)

\( \newcommand{\vectorA}[1]{\vec{#1}}      % arrow\)

\( \newcommand{\vectorAt}[1]{\vec{\text{#1}}}      % arrow\)

\( \newcommand{\vectorB}[1]{\overset { \scriptstyle \rightharpoonup} {\mathbf{#1}} } \)

\( \newcommand{\vectorC}[1]{\textbf{#1}} \)

\( \newcommand{\vectorD}[1]{\overrightarrow{#1}} \)

\( \newcommand{\vectorDt}[1]{\overrightarrow{\text{#1}}} \)

\( \newcommand{\vectE}[1]{\overset{-\!-\!\rightharpoonup}{\vphantom{a}\smash{\mathbf {#1}}}} \)

You may not know what I mean when I say 5 Paragraph Essay, but even if the name is unfamiliar, the concepts of it are probably something you recall doing often in your prior education.  In short, it is an essay where the following format was used:

• Intro Paragraph (with a thesis statement in the last sentence or two…sometimes underlined)
• Body #1 (the first point of the larger subject that you will address and likely mentioned in the thesis)
• Body #2 (the second point of the larger subject that you will address and likely mentioned in the thesis)
• Body #3 (the third point of the larger subject that you will address and likely mentioned in the thesis)
• Conclusion (reiterate what you have already written and restate the thesis)

Does this look familiar now?  Most of you probably used it extensively throughout high school (if that was your last educational experience) regardless of the subject/class you were in.  It was likely a catch-all and worked for any and all subject matters from history to social studies.  The question is whether this same format will work in college.  The following are notes to consider as to the merits and/or downfalls of this familiar essay format:

5¶E (Five Paragraph Essay)

Two missing, most important factors which are integral and necessary in all good writing:

To whom are you writing?

Why are you writing?

The Five Paragraph Essay is devoid of any consideration of AUDIENCE and PURPOSE since the audience is always the teacher and the purpose largely revolves around getting a good grade by pleasing the teacher.  The idea that you are writing to a teacher for a grade is not realistic in real world writing and will not likely work for all of your paper assignments in college.  That said, you need not abandon ship on it all together, but there is a real likelihood that it will not work in all instances, even in academic settings.  AUDIENCE and PURPOSE are key in all quality writing and the Five Paragraph Essay does not account for these.  If one considers these two factors, it can help shape how you approach writing and how the structure will unfold.  To demonstrate, consider the following:

1) You’re writing an email to a friend asking him/her to come visit this weekend.

2) You got pulled over recently and you’re writing a letter to the judge to ask for clemency.

What would both of these writing instances sound/look like?  Would the tone and structure be the same for each of these instances?  The Five Paragraph Essay assumes they would, and thus you should be able to switch out the writing in each situation.  Do you think you’d write a formal email to your friend or an informal letter to the judge?  This is why AUDIENCE and  PURPOSE are so important to succeeding in writing.

• 5u00b6E - What is the 5 Paragraph Essay?. Authored by : Jason Brown. Provided by : Herkimer College. Project : AtD OER Course. License : CC BY: Attribution

Join my VIP teacher email club!

When I look back to my first experience teaching five paragraph essays to fifth graders, I can remember how terribly unprepared I felt.

I knew that the five paragraph essay format was what my students needed to help them pass our state’s writing assessment but I had no idea where to start.

I researched the few grade-appropriate essays I could find online (these were the days before Pinterest and Teachers Pay Teachers) and determined that there was a structure to follow.

Every essay followed the same basic structure. I taught the structure to my students and they did well.

I have been teaching five paragraph essay structure and everything that goes with it for several years now. I hope that after you read this blog post, you will have a good understanding of how to teach and grade five paragraph essays.

Once you’ve learned all about teaching basic essay structure, you’ll be ready to grow your writers from “blah” to brilliant! 

Teaching five paragraph essays is just one part of teaching 5th grade writing. Click here to find out exactly how I teach writing to my 5th graders! 

Start with Simple Paragraphs

We always start with simple paragraphs.

Yes, this is basic, but if your students cannot write excellent paragraphs, their five paragraph essays will be train wrecks. Trust me!

We spend a while cementing paragraph structure:

Topic Sentence

Closing Sentence

I give students topics, they come up with their own topics, we write together, they write with a partner or independently, the more variety, the better.

We have fun with simple paragraphs. Then, it’s time to move on to body paragraphs.

Organize and Write Body Paragraphs

Please refer to my five paragraph essay organizer below.

The three body paragraphs are absolutely crucial to the success of the five paragraph essay.

Some teachers have trouble teaching the structure of five paragraph essays because they start with the introduction paragraph.

Always teach the body paragraphs first!

I had a teacher say to me once, “What’s the point of just writing parts of the essay? They need to write the entire five paragraphs to get all of the practice they need.”

I understand that point. However, think of it as building a house. Should you test out the foundation and make sure it’s sound and sturdy before building on top of it? Absolutely! That’s what we’re doing here.

The three body paragraphs are the foundation of the essay.

Ask students to write out their three body paragraphs just like they have practiced…Topic sentence…Detail 1…Detail 2…Detail 3…Closing Sentence.

I “ooooh and aaaah” over their three paragraphs. Students are on their way to five paragraph essays, so be sure to build their confidence.

Teach the Introduction Paragraph

I have to say, this is my favorite paragraph to teach. The introduction paragraph is what draws readers into the essay and makes them want to read more.

We start with what I call a “hook.” The hook captures the readers’ attention and can come in many forms: asking a question, making a bold statement, sharing a memory, etc.

After the hook, I ask students to add a sentence or two of applicable commentary about the hook or about the prompt in general.

Finally, we add the thesis sentence. The thesis sentence always follows the same formula: Restate the prompt, topic 1, topic 2, and topic 3.

That’s all you need to write an excellent introduction paragraph!

I do suggest having students write the introduction paragraph plus body paragraphs a couple of times before teaching the closing paragraph.

Teach the Closing Paragraph

In the conclusion paragraph, we mainly focus on restating the thesis and including an engaging closing thought.

With my students, I use the analogy of a gift.

The introduction paragraph and body paragraphs are the gift and the conclusion paragraph is the ribbon that ties everything together and finishes the package.

When you talk about restating the thesis sentence, tell students that they need to make it sound different enough from their original thesis sentence to save their readers from boredom.

Who wants to read the same thing twice? No one!

Students can change up the format and wording a bit to make it fresh.

I enjoy teaching the closing thought because it’s so open to however students want to create it.

Ways to write the closing thought: ask a question, personal statement, call to action, or even a quote. 

I especially like reading the essays in which a quote is used as a closing thought or a powerful statement is used.

Example of a full five paragraph essay

Let’s Talk About Color-Coding!

Who doesn’t like to color? This is coloring with a purpose!

Training your students to color-code their paragraphs and essays will make grading so much easier and will provide reminders and reinforcements for students.

When students color-code their writing, they must think about the parts of their paragraphs, like topic sentences, details, and the closing sentence.

They will be able to see if they are missing something or if they’ve written something out of order.

Color-coding is a wonderful help for the teacher because you can skim to ensure that all parts of your students’ paragraphs and essays are present.

Also, when you are grading, you can quickly scan the paragraphs and essays. Trust me, you will develop a quick essay-grading ability.

I start color-coding with my students at the very beginning when they are working on simple paragraphs. I add the additional elements of the color-code as we progress through our five paragraph essays.

This is the code that I use:

Let’s Talk About Grading Five Paragraph Essays!

Imagine a lonely, stressed teacher grading five paragraph essays on the couch while her husband is working the night shift.

That was me!

Seriously, guys, I would spend about ten minutes per essay. I marked every little error, I made notes for improvement and notes of encouragement. I reworked their incorrect structure.

Those papers were full of marks.

On Monday, I proudly brought back the essays and asked students to look over them and learn what they needed to fix for next time.

You can guess what happened… there were lots of graded essays in the trashcan at the end of the day.

I decided that my grading practices had to change. I needed my weekends back and my students needed to find their own errors!

This is my best advice:

STOP correcting every error!

Your students are not benefiting from marks all over their writing. They need to find those errors themselves so that they will remember their mistakes and change their writing habits.

Do a quick scan of each student’s writing as soon as it’s turned in to you.

If there are major problems with a student’s writing, call him/her over individually and show him/her what needs to be fixed or put the student with a competent peer editor who will help them fix mistakes.

If you have several students who are struggling with a skill, like closing sentences, do a mini-lesson on this topic.

You can do a mini-lesson with a small group. However, I prefer doing mini-lessons with the entire class. The kids who need help will get it and the rest of your class will receive a refresher.

It’s OK if there are some small spelling/grammar mistakes!

If the errors are few and they don’t take away from the meaning/flow of the essay, I don’t worry about them.

Our students are still learning.

Even your brightest star writer will have a few spelling/grammar mistakes from time to time.

Don’t discourage students from writing because of small errors.

Students who receive papers back with markings all over them don’t think, “Oh boy, my teacher has made it so easy for me to make all of these corrections.” They are thinking, “What’s the point in writing? I must be a terrible writer. Look at all of these mistakes.”

If your students are taking a standardized writing assessment, the structure and flow of their essays will be worth much more than perfect spelling.

Need more help?

I created this five paragraph essay instructional unit for teachers who are new to teaching five paragraph essays OR just need all of the materials in one place.

“Teacher Talk” pages will guide you through the unit and this unit contains all materials needed to help students plan, organize, and write amazing five paragraph essays! Click here to check it out:

I have a freebie for you! Enter your first name and email address below. You’ll receive three original prompts with five paragraph essay organizers AND two lined final draft pages!

Once your students are good essay writers…

These task cards will help your students stay sharp on their five paragraph essay knowledge. Students will review hooks (attention-getters), thesis sentences, body paragraphs, topic sentences, closings, and more. Each card contains a unique writing example!

I suggest using these task cards as a quiz/test, scoot game, individual review, or cooperative group activity.

Click on the image to view these task cards:

To save this post for later, simply pin this image to your teacher Pinterest board!

21 comments.

Wow! I really enjoyed reading this. I’ve always stressed over the thought of teaching writing, but your blog makes me think I can do it successfully. Putting your writing packet on my TPT wish list!

Thank you, Shannon! I appreciate you taking the time to leave a comment. I am so glad that my blog post was helpful to you!

Thanks for the tips! When I taught 6th grade I taught this same subject matter, but struggled to get started. I wish I had this then!

I appreciate your comment! Teaching was much different before Pinterest, wasn’t it?!?

This helped me so much!🙂 thanks a lot, I imagined being one student of yours. I’d be so smart and good at essays! Would’ve been so much easier in person❤️❤️❤️

Thank you so much, Aizlyn!

Thank you so much for this! May I ask where I can see the rubric for scoring the compositions?

You are so welcome! Click on the resource link. Then, you will see the rubric in the preview!

Thank you so much,I am a parent and this really helped me be clear how to guide my son. God bless you always.,

Thanks for taking the time to leave a comment!

you are welcome!!!

This looks great! Looking forward to using your tips and freebies with my 6th graders. 🙂 THANK YOU.

You are so welcome! Thank you for taking the time to leave a comment!

Can’t wait to use this with my class tomorrow! Thanks a bunch for sharing!!

You are so welcome, Amy!

Thank you for making it easy to teach an essay with clarity.

You are very welcome, Yamuna! Thanks for taking the time to leave feedback 🙂

I am so happy I discovered your blog. I just started teaching grade 5 in September I have been searching for a simple method to hel me in guiding them in writing. I will be putting your method into practice in the coming week.

That’s wonderful, Cherry! Thank you for sharing your thoughts! Welcome to fifth grade 🙂

Beautiful lesson well explained! Thank you so very much .

Thank you so much, Cheryl!

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Notify me of follow-up comments by email.

Notify me of new posts by email.

This site uses Akismet to reduce spam. Learn how your comment data is processed .

You may also enjoy...

History Meme Project for Students

How to Use Ben Franklin’s Witty Quotes in Your Classroom

How to Make Your Social Studies Class More ‘Social’

How to Make the U.S. Constitution Accessible for Students

Teaching About 18th Century Colonial Money

How to Teach Writing Using Paired Passages

What can i help you teach, find it here, let's connect, i'd love to connect with you.

Enter your first name and email address to join my exclusive VIP email club.

Copyright © 2020  | Thrive in Grade Five | All Rights Reserved

Quick Links

Microsoft 365 Life Hacks > Writing > The pros and cons of the five-paragraph essay

The pros and cons of the five-paragraph essay

The five-paragraph essay is a writing structure typically taught in high school. Structurally, it consists of an introductory paragraph, three body paragraphs, and a conclusion. This clear structure helps students connect points into a succinct argument. It’s a great introductory structure, but only using this writing formula has its limitations.

What is a five-paragraph essay?

Outside of the self-titled structure, the five-paragraph essay has additional rules. To start, your introductory paragraph should include a hook to captivate your audience. It should also introduce your thesis , or the argument you are proving. The thesis should be one sentence, conclude your introductory paragraph, and include supporting points. These points will become the body of your essay. The body paragraphs should introduce a specific point, include examples and supporting information, and then conclude. This process is repeated until you reach the fifth concluding paragraph, in which you summarize your essay.

Get the most out of your documents with Word

Elevate your writing and collaborate with others - anywhere, anytime

The benefits of a five-paragraph essay

• Your ideas are clear. Presenting your ideas in a succinct, organized manner makes them easy to understand and the five-paragraph essay is designed for that. It provides a clear outline to follow. And most importantly, it’s organized around the thesis, so the argument can be traced from the beginning of the essay to its conclusion. When learning how to write essays, losing track of your thesis can be a common mistake. By using this structure, it’s harder to go on tangents. Each of your points are condensed into a single paragraph. If you struggle presenting your ideas, following this structure might be your best bet.
• It’s simple. Creating an essay structure takes additional brainpower and time to craft. If an essay is timed in an exam, relying on this method is helpful. You can quickly convey your ideas so you can spend more time writing and less structuring your essay.
• It helps build your writing skills. If you’re new to writing essays, this is a great tool. Since the structure is taken care of, you can practice writing and build your skills. Learn more writing tips to improve your essays.

The cons of writing a five-paragraph essay

• The structure is rigid. Depending on its usage, the structure and convention of the five paragraphs can make creating an essay easier to understand and write. However, for writing outside of a traditional high school essay, this format can be limiting. To illustrate points creatively, you might want to create a different structure to illustrate your argument.
• Writing becomes repetitive. This format quickly becomes repetitive. Moving from body-to-body paragraph using the same rules and format creates a predictable rhythm. Reading this predictable format can become dull. And if you’re writing for a college professor, they will want you to showcase creativity in your writing. Try using a different essay structure to make your writing more interesting
• Lack of transitions. Quickly moving through ideas in a five-paragraph structure essay doesn’t always leave room for transitions. The structure is too succinct. Each paragraph only leaves enough space for a writer to broadly delve into an idea and then move onto the next. In longer essays, you can use additional paragraphs to connect ideas. Without transitions, essays in this format can feel choppy, as each point is detached from the previous one
• Its rules can feel unnecessary. Breaking your essay into three body paragraphs keeps it concise. But is three the perfect number of body paragraphs? Some arguments might need more support than three points to substantiate them. Limiting your argument to three points can weaken its credibility and can feel arbitrary for a writer to stick to.

Creating essays using the five-paragraph structure is situational. Use your best judgement to decide when to take advantage of this essay formula. If you’re writing on a computer with Microsoft Word , try using Microsoft Editor to edit your essay.

Get started with Microsoft 365

It’s the Office you know, plus the tools to help you work better together, so you can get more done—anytime, anywhere.

Topics in this article

More articles like this one.

What is independent publishing?

Avoid the hassle of shopping your book around to publishing houses. Publish your book independently and understand the benefits it provides for your as an author.

What are literary tropes?

Engage your audience with literary tropes. Learn about different types of literary tropes, like metaphors and oxymorons, to elevate your writing.

What are genre tropes?

Your favorite genres are filled with unifying tropes that can define them or are meant to be subverted.

What is literary fiction?

Define literary fiction and learn what sets it apart from genre fiction.

Everything you need to achieve more in less time

Get powerful productivity and security apps with Microsoft 365

Explore Other Categories

Unlearning the Five Paragraph Essay

A key challenge for our freshmen students in the transition from high school to college is to unlearn the five paragraph essay.

I call the five paragraph essay a hot house flower because it cannot blossom in the sun. No professional writers actually use this form. College instructors may be baffled when they witness it. Yet it is the main form that our freshmen students know and deploy.

Unlearning the five paragraph essay may be a greater challenge for our students than learning how to write—with all its messiness—in the first place. As anyone who has tried to master a second language knows, the first language creates interference. We fall back on the inherited patterns of the first language which impede our mastery of the second.

What is the five paragraph essay?

The five paragraph essay encourages its practitioners to produce a thesis with three parts and then to map those three parts onto body paragraphs followed by a conclusion.

The five paragraph essay gives the writer the false comfort of a formula into which to plug ideas. It takes the sting out of thinking—which is one of the primary challenges of writing—and promises us whatever our thoughts, we can reduce them to an over-simplified format.

I have witnessed some student writers attempting to produce six page papers with five horribly bloated paragraphs. It’s like religiously following Siri-narrated map directions into an adjacent lake.

As long as you are not a stickler for nomenclature, some longer essays are also five paragraph essays when they hew to its peculiar logic of listing and mapping. Not all essays with five paragraphs are five paragraph essays when they grow organically—based on a writer’s purposes and design—rather than being held hostage to a formula.

Why is the five paragraph essay a weak form?

It distorts what a thesis is.

This distortion is both conceptual and syntactic.

A thesis presents an arguable idea and also serves as the controlling generalization for the essay as a whole.

One way of conceptualizing a thesis is to use the metaphor of an umbrella (this metaphor comes from an  article   written by my colleague Karen Gocsik). A thesis is like an umbrella because it is large enough to cover the full range of ideas explored in body paragraphs. When a thesis is distorted by being broken down into the three parts which are then mapped onto the body paragraphs, it serves as three little umbrellas rather than one large one. Student writers aren’t learning to generalize, but to find a poor substitute for generalizing. The three little umbrellas aren't keeping them from getting soaked.

In its crudest form, the three part thesis often devolves into identifying subjects rather than arguments and identifies the areas of focus picked up by the body paragraphs. For example, a student writer might decide to address the issue of friendship in literature, history, and personal experience. Such a tentative thesis focuses on a subject (“friendship”) and three major areas where the writer hopes to address that subject. The writer never identifies the claim about friendship to be developed in the essay, nor even wonders whether it is useful to address these claims in such disparate areas as literature, history, and personal experience. Rather, he or she just joins or adds these three disparate areas together as though they formed an automatically meaningful sequence.

Finally, when a thesis is divided into three parts, the sentence which reports these three parts itself frequently breaks down. It is difficult enough to express an idea in a complete sentence. Try encapsulating three ideas, joining them together, and jamming them into the thesis. Chaos generally ensues.

It distorts the organization of an essay.

The sole organizing principle of the five paragraph essay is that of addition.

A well organized essay is more than the sum of its parts.

Consider the various components that might be included in an essay.

A writer might want to highlight major ideas or issues and minor ones as well.

A writer may want to anticipate and address the arguments of others that run counter to his or her own.

A writer might wish to explain the complicated reasons behind any given phenomenon (mass incarceration, global warming, income disparity) and identify which ones are most compelling and why.

In order to perform the first task one might organize according to a relationship of emphasis: most important, less important, less important still.

In order to perform the second task, one might compare and contrast the various arguments.

In order to perform the third task, one might devote a paragraph to defining the phenomenon and the next to identifying and assessing its causes.

Because it is too rigid in its over-reliance on addition, the five paragraph essay would not allow a writer to organize via emphasis, contrast, or causality. Rather the ideas would have to be presented illogically (as additions) when they should be organized according to other types of relationships which would reflect the real purpose for writing. The form itself encourages incoherence.

The five paragraph essay takes meaning making out of the writer’s hands.

An essay is a vehicle for exploring ideas and creating meaning.

In order to explore ideas, a writer makes a series of decisions about how to present, develop, and organize them.

In order to create meaning, a writer decides how to sequence sentence after sentence and paragraph after paragraph.

The five paragraph essay takes many of these decisions away from the writer. It promises that a formula will replace decision and meaning making. As long as a writer plugs into the formula, the reader will be electrified by the magical results.

As a consequence, students do not develop strategies for the complex expression of their own ideas. How do I best express them? Why should I organize in one way rather than another? How do I anticipate a reader's response to my argument?

It creates the illusion that the form creates meaning instead of the writer. It creates the illusion that it is the sole or primary form so that student writers never learn the full variety of formal approaches.

The five paragraph essay may have been developed out of a well-meaning effort to simplify essay writing for novice writers.But it is not merely a simplification of essay writing, it is an over-simplification.  And as such, it limits the development of the cognitive abilities of student writers.

The five paragraph essay does not encourage students to develop the ability to be critical about their own strengths and weaknesses as writers because it turns writing into a check-list of features that are either present or absent.

Why should college instructors pay attention to what students have learned in the past?

Teaching students about writing requires an understanding and acknowledgment about their earlier instruction in the five paragraph essay.

Without understanding the nature of and the reasoning for that past instruction, you will appear to undermine that instruction without a real purpose.

Students won't understand why they are being asked to adapt to a new, unusual, and even strange mode of writing instruction.

They will fall into the familiar and comfortable formulas taught to them in the past because you won't have given them reasons for the new instruction about writing and the challenges you put in their path.

You might not even know that your instruction in writing is new to your students.

In that regard, you and your students may be on a common ground: what is familiar to each of you may not be familiar to the other.

But that common ground is not fertile ground for teaching or learning.

Unlearning the five paragraph essay means unteaching it as well.

How to write an Essay Introduction (5-Step Formula)

One of my friends – a high-up professor in an English university – told me he can tell the grade a student will get within the first 90 seconds of reading a paper.

This makes the introduction the most important paragraph in your whole paper.

The introduction orients your reader to how well you understand academic writing, your skills in critical thinking, your ability to write professionally with minimal errors, and the depth of knowledge you have on the topic.

All in one fantastic paragraph! No pressure.

No wonder introductions are so difficult to write. If you’re like me, you find that you can sit and stare at a blank page as the moments tick by. You’re just not sure how to write an introduction!

After reading the top 30 online articles on how to write an essay introduction, I synthesized the five most common steps that universities give on how to write an introduction.

The five steps I am going to introduce to you in this paragraph are from my I.N.T.R.O. method. The intro method provides an easy-to-use acronym for how to write an introduction that the top universities recommend.

The INTRO method’s steps are:

• [I] Interest: Provide an opening sentence that shows why the topic is of interest to everyday human beings
• [N] Notify: Notify the reader of background or contextual information
• [T] Translate: Translate the essay topic or question by paraphrasing it
• [R] Report: Report on your position or argument
• [O] Outline: Provide an outline of the essay structure

Below, I go through each step one by one. Each step is designed to be written in order, although you may feel free to mix them up after you’ve written each sentence to make it feel and read just the way you like.

Use the INTRO method as a guide for how to write an introduction and get words down on paper. As I often argue on this website, just writing something is often the hardest part .

You may also find that some essay introductions work better without one or more of these 5 steps. That is okay, too. Use these 5 steps as advice on points to include in an introduction and adjust them as you need. You may find in your specific area of study you need to add or remove other sentences. Play around with your introduction until you feel comfortable with it.

So don’t be too hard on yourself: have a go at a draft of your introduction with no pressure to use it in the end. You’ll find by the time you’ve written these five sentences you’ll have the creative juices flowing and a compelling introduction will be down on paper in no time.

1. Interest

Provide an opening sentence that shows why the topic is interesting to everyday human beings

Nearly every source on how to write an introduction that I found online recommended that your first sentence be an engaging ‘hook’ . Most sources highlight that the ‘hook’ sentence should draw in the reader’s interest in order to make your piece stand out.

The marker wants to see if you understand why this topic is of interest is in the first place. They want to see if you ‘get it’ from the very start.

I also recommend that you view the hook as an opportunity to show why the topic is interesting to everyday human beings . This makes it relevant to your reader.

To show you understand why the topic is of interest in the first place, aim to do one of the following things:

• Show what makes the topic worth discussing. Your ‘Interest’ sentence might help show why someone should care about the topic. Will it affect our livelihoods? Will it harm us? Make our work lives easier? The more relatable this point is to real human lives, the better.
• Highlight the single most interesting point in the essay. You might notice that you have already pointed out this interesting ‘hook’ somewhere in your essay. Find that interesting, relatable point and make it the opening sentence of your introduction.
• Use an interesting fact or figure to show the topic’s importance. Percentages or real numbers about how many people are or would be impacted by the issue help to show the topic’s importance. This will create reader interest with a ‘wow’ factor.
• Show how the essay topic is relevant to today’s world. If you’re struggling to identify this interesting ‘hook’, go onto google and find news reports related to your topic. How has the topic made it into the news recently? The news report will help you to brainstorm why this topic is of interest to the everyday lives of real human beings.

However, do not overstate the issue. You should provide a clear, reasonable perspective in this first sentence rather than an over-the-top claim. For example, aim to avoid hyperbolic or overly emotional phrases:

To find out more about retracting over-the-top emotion and hyperbole, we have put together a guide on academic language that you may like to read.

To summarize, I recommend that your first step in how to write an introduction is to write a ‘hook’ sentence that focuses on why the topic is interesting to everyday human beings . Use sober, clear facts about the importance of the topic to real human lives to get yourself started.

Read Also: My Suggested Best Words to Start a Paragraph

Notify the reader of background or contextual information

Nearly every source I found also recommended that you provide brief ‘background’ or ‘contextual’ information.

‘Background’ or ‘contextual’ information shows your depth of knowledge and understanding of the topic.

Here are some examples of ‘context’ for a few topics:

Hopefully, you can see here that giving ‘context’ is a way of showing that you have a really strong or deep knowledge of the history or background story of the topic. This is your chance to differentiate your depth of knowledge from other students. A sentence or two giving some of this context also helps to show off your knowledge right from the start.

Most sources recommend only providing one or two sentences of background information. This will help you to show off your knowledge without stealing content from the body of your essay. The body of the essay will add depth and detail to your points in the introduction, so feel free to leave out examples and explanations beyond your engaging sentence or two: you will have time in the body of the essay to elaborate.

3. Translate

Translate the essay topic or question

This point was mentioned by more than half the websites I found giving advice on how to write an introduction.

Many universities recommend re-stating the essay topic or question in your own words. This helps your marker to see that you understand the topic and are directly addressing it.

Here are some examples of essay questions and ways you can re-state the essay question in your introduction:

Something to keep in mind is that you do not want to appear to be re-stating the essay question simply to take up extra words. We call this ‘padding’. An example of padding is when a student drops the essay question in as a question, word-for-word:

• How can knowledge about history help us to improve our lives in the future? This is the question that will be answered in this essay.
• This essay will answer the question “What is the lasting impact of European Colonisation in the 21 st Century?”

Do not drop the essay question into the introduction without paraphrasing or surrounding explanation. If you do this, your marker will think you’re just trying to add words to the introduction because you’re not sure of anything interesting to say

Report your position or argument

Most essays do not require you to take a stance on an issue.

Essays that do require you to take a stance are called either ‘argumentative essays’ or ‘persuasive essays’.

If you are writing a persuasive essay, you will need to include Step 4: Report. For this step, you’ll need to state where you stand on the issue:

Keep in mind that essays should never leave a reader confused. Essay writing is not like creative writing: your reader must always know what’s going to be said right from the start. When reading to gather information, readers don’t like to be surprised. They want the facts up-front. Therefore, your marker will expect to know what your stance is on the issue right from the introduction onwards.

Provide an outline of the Essay Structure

This last point on how to write an introduction is important and separates average students from top students.

Introductions should always highlight the key points that will be made in an essay. Academic writing should never surprise the reader.

The fact that steps 4 and 5 both highlight that you should orient your marker reinforces the importance of this. Always, always, guide your marker’s reading experience.

Your essay should signpost all key concepts, theories, and main sections that make up your essay. If an important point is made in the essay but not signposted in the introduction, you are likely to confuse your marker. A confused marker very rapidly lowers your mark.

Too often, students fail to outline key points of their essays in the introduction. Make a habit of signposting your key ideas, points, theories, or concepts you will cover in the introduction in order to gain marks.

It is always easier to write this outline once the essay plan is written. You will then be able to gather together the key points that you listed in your essay plan and include them in the introduction.

The outline of the essay structure can only be one or two sentences long. You can state as your last sentence in your introduction:

• “Firstly, this essay … then, …, and finally …”
• “The essay opens with …, then, …, and then closes with …”
• “After exploring …, … and …, this essay will conclude with …”

Try to outline the issues you will cover in order. Providing an orderly outline of your essay is very helpful for your reader.

Now, I know that some people don’t like this method. Let me reassure you with this study from Theresa Thonney in 2016. Thonney examined 600 top-ranking articles in fields including Literature, Music, Environmental Sciences, Nutrition, Inter-Cultural Studies, and more to see how many articles used this method. In other words, she completed a comprehensive study of whether professional, published authors use this method of orientating the reader to the structure of the article.

Thonney found that 100% of top-ranking articles she looked at in the Astronomy field used this method. 98% of articles in Sociology journals used this method. In fact, the field with the lowest amount of authors who use this method is Art, which had 76% of authors use this method. In other words, even the lowest result she found showed that three in every four professional authors use this method.

So, you should too.

Let’s sum point 5 up by reinforcing this very important rule: your marker should always be very clear about what they will read, and in what order, to improve their reading experience.

A short list of things to Avoid in Introductions

I want to conclude this post with an outline of some of the worst things you can do in an introduction. The introduction sets the scene, so you want to make a good impression. You don’t want your marker taking away marks due to one of these top mistakes:

• Rhetorical Questions.
• Vague padding.
• Dictionary definitions.

Sometimes, teachers also recommend avoiding referencing in introductions. I have colleagues who absolutely refuse to let students include references in their introductions. Personally, I think that’s absurd – if a reference is required, include it! However, check with your teacher on their personal preferences here as I know this is a point of contention in faculty lounges.

The introduction is important for creating a strong first impression, especially since markers often make up their mind about your grade very early on in the marking process.

Introductions are best written last. That way, you will be able to include all the signposting you need to do (step 5), have a good understanding of the context (step 2), and be more certain about what your stance is on the issue (step 4).

Here’s the five INTRO steps I’d encourage you to use every time:

Once you have written your introduction, it is a good idea to put it away for a few days and then come back to edit it with fresh eyes . Remember that grammar and punctuation are important in the introduction. You want to leave a good impression.

If you have a friend who can read the draft for you and give you tips, or if your teacher has drop-in hours, use them to get some tips on how to write an introduction, what sounds right, want sounds off, and how you might be able to improve your introduction.

Once you have written your introduction, you might want to have a look at our guidance on how to write conclusions in order to end your piece as strongly as you started! People often think conclusions are just like introductions. That’s not true. Conclusions are unique paragraphs, so head over to our guidance on conclusions now to get the support you need on writing the best conclusion you can.

Chris Drew (PhD)

Dr. Chris Drew is the founder of the Helpful Professor. He holds a PhD in education and has published over 20 articles in scholarly journals. He is the former editor of the Journal of Learning Development in Higher Education. [Image Descriptor: Photo of Chris]

• Chris Drew (PhD) https://helpfulprofessor.com/author/chris-drew-phd/ 15 Self-Actualization Examples (Maslow's Hierarchy)
• Chris Drew (PhD) https://helpfulprofessor.com/author/chris-drew-phd/ Forest Schools Philosophy & Curriculum, Explained!
• Chris Drew (PhD) https://helpfulprofessor.com/author/chris-drew-phd/ Montessori's 4 Planes of Development, Explained!
• Chris Drew (PhD) https://helpfulprofessor.com/author/chris-drew-phd/ Montessori vs Reggio Emilia vs Steiner-Waldorf vs Froebel

Leave a Comment Cancel Reply

Your email address will not be published. Required fields are marked *

• >> Return to Heinemann.com

Dedicated to Teachers

• Penny Kittle
• Creative Writing
• Kelly Gallagher
• Teaching Writing
• 4 Essential Studies
• Middle School
• Education Policy
• Language Arts
• Lucy Calkins
• View All Topics

Why the Five-Paragraph Essay is a Problem Now—and Later

Belief #1: The five-paragraph essay is a problem now

Current common approaches for teaching writing are simultaneously too punishing and not nearly challenging enough. Part of the problem is how “rigor” is viewed in education. “Rigor” means “strictness” and “severity.” It is an artifact of a different time and a different mentality toward schooling. It remains popular mostly as a way to invoke days of yore that are supposedly better than today. . . . When students say a class was “hard,” they often mean “confusing” or “arbitrary,” rather than stimulating and challenging. (2018, 142)

We would add the following to the list of arbitrary and confusing approaches to teaching writing: rules that demand paragraphs will contain five (or nine or whatever) sentences; the topic sentence will always be first in each paragraph; and the thesis or claim must always be directly stated in the introduction. These rules do not represent excellence in writing. On the contrary: in many cases, adhering to them wrings the goodness out of writing. The writer is punished by being shoehorned into a form. Peter Elbow, noted writing researcher, argues that “the five-paragraph essay tends to function as an anti-perplexity machine” (2012, 308). Katherine Bomer agrees, adding, “There is no room for the untidiness of inquiry or complexity and therefore no energy in the writing” (2016, xi). Not only is energy drained from the writing when students practice mechanized thinking, but students also lose the valuable practice of generating and organizing ideas. When the form is predetermined, much of the writer’s important decision-making has already been stripped, which is one reason Penny is now encountering so many college students who believe they cannot solve their own writing problems.

We agree with John Warner’s notion that approaches taken by writing teachers are “not nearly challenging enough” (2018, 142). The form does the thinking for the student, and the student simply plugs in and follows. Without an understanding of options, students can’t imagine how a different form might better engage an audience or how changing the structure might better communicate their ideas. Teachers in high school rarely (if ever) meet across content areas to consider how often students are writing the exact same formulaic essays. The teachers at our schools never met to have these discussions. Students need numerous opportunities to study the various forms an essay can take, and they need repeated practice experimenting. This is not our only objection, however. The lack of student decision-making and agency is compounded when students are constrained by the teacher’s choice of subject and the lack of an authentic audience for their writing. We like how novelist Lily King explains the problems with standardized essays about books:

While you’re reading [the book] rubs off on you and your mind starts working like that for a while. I love that. That reverberation for me is what is most important about literature. . . . I would want kids to talk and write about how the book makes them feel, what it reminded them of, if it changed their thoughts about anything. . . . Questions like [man versus nature] are designed to pull you completely out of the story. . . . Why would you want to pull kids out of the story? You want to push them further in, so they can feel everything the author tried so hard to create for them. (2020, 271)

Night has fallen and is swirling and twirling around me. Gold chains hang across his neckline like trophies against a prize. The fine oil paintings and white pillars line sunken walls. It is a life filled with artificial riches, swishing like change in a pocket of hope. And the noises it made rustled in our dreams.

Abby writes with verve and authenticity. Jillian, the same age, is sitting in a first-year college classroom without the skill set to make the decisions expected of her. And we know this: students get to Abby’s level of essay writing when they’ve experienced a lot of practice in struggling with generating ideas and organizing their thinking. The road to excellence is rife with trial and error. It is up to us to entrust our young writers to wrestle with their decisions. Doing so matters now. And later.

Penny Kittle teaches freshman composition at Plymouth State University in New Hampshire. She was a teacher and literacy coach in public schools for 34 years, 21 of those spent at Kennett High School in North Conway. She is the co-author (with Kelly Gallagher) of   Four Essential Studies: Beliefs and Practices to Reclaim Student Agency , as well as the bestselling  180 Days .

Penny is the author of  Book Love  and  Write Beside Them , which won the NCTE James Britton award. She also co-authored two books with her mentor, Don Graves, and co-edited (with Tom Newkirk) a collection of Graves’ work,  Children Want to Write .  She is the president of the Book Love Foundation and was given the Exemplary Leader Award from NCTE’s Conference on English Leadership. In the summer Penny teaches graduate students at the University of New Hampshire Literacy Institutes.  Throughout the year, she travels across the U.S. and Canada (and once in awhile quite a bit farther) speaking to teachers about empowering students through independence in literacy. She believes in curiosity, engagement, and deep thinking in schools for both students and their teachers. Penny stands on the shoulders of her mentors, the Dons (Murray & Graves), and the Toms (Newkirk & Romano), in her belief that intentional teaching in a reading and writing workshop brings the greatest student investment and learning in a classroom.

Learn more about Penny Kittle on her websites,   pennykittle.net   and   booklovefoundation.org , or follow her on   twitter .

Topics: Penny Kittle , Creative Writing , Kelly Gallagher , Teaching Writing , 4 Essential Studies

Recent Posts

Popular posts, related posts, summer sale for teachers: heinemann audiobooks, on the podcast: the dispatch with penny kittle and kelly gallagher, 4 essential studies with penny kittle, kelly gallagher, and tom newkirk, putting books into the hands of teachers of teenagers: the book love foundation.

© 2023 Heinemann, a division of Houghton Mifflin Harcourt

Beyond the Five-Paragraph Essay

What's wrong with the formula, going beyond the formula, close reading as preparation for writing, developing an authoritative voice, low-stakes writing and gathering evidence, moving from question to stand, supporting organization, expect resistance.

Premium Resource

"We must teach the five-paragraph format! Students need a starting place when writing essays." "They need the formula to do well on standardized tests." "We need to be sure kids are prepared for college writing."

Students learn that writing means following a set of instructions, filling in the blanks. Such writing mirrors working-class life, which requires little individual thinking and creativity combined with lots of monotony and following orders …. Writing … should not be yet another way to train students to be obedient citizens." (Brannon et al., 2008, p. 18)

• Do you want to keep reading after the first paragraph? Why or why not? What is the author's argument (stand)?
• Focus on the author's evidence: Are there places where you agree with the author's argument? What is effective in these places? Where do you have questions or need more information?
• Are there arguments the author should consider adding?
• What evidence could you offer to challenge the author's stand?

Albertson, B. R. (2007). Organization and development features of Grade 8 and Grade 10 writers: A descriptive study of Delaware Student Testing Program (DTSP) essays. Research in the Teaching of English, 41 (4), 453–464.

Argys, R. (2008). One more thing: Can we teach process writing and formulaic response? English Journal, 97 (3), 97–101.

Brannon, L., Courtney, J. P., Urbanski, C. P., Woodward, S. V., Reynolds, J. M., Iannone, A. E., & Kendrick, M. (2008). The five-paragraph essay and the deficit model of education. English Journal, 98 (2), 16–21.

Courtney, J. P. (2008). Performing student, teacher, and tutor of writing: Negotiating ideas of writing in first-year writing courses and writing center tutorials . Unpublished doctoral dissertation, University of North Carolina, Charlotte.

Elbow, P. (1997). High stakes and low stakes in assigning and responding to writing. In M. S. Sorcinelli & P. Elbow (Eds.), Writing to learn: Strategies for assigning and responding to writing across the disciplines (Vol. 2, pp. 5–14). San Francisco: Jossey-Bass.

Fanwetti, S., Bushrow, K. M., & DeWeese, D. L. (2010). Closing the gap between high school writing instruction and college writing expectations. English Journal, 99 (4), 77–83.

Hillocks, G., Jr. (2002). The testing trap . New York: Teachers College Press.

National Commission on Writing in America's Schools and Colleges. (2003). The neglected "R": The need for a writing revolution . New York: College Board.

Nunnally, T. E. (1991). Breaking the five paragraph theme barrier. English Journal, 80 (1), 67–71.

Prose, F. (2006). Reading like a writer: A guide for people who like books and for those who want to write them . New York: Harper Perennial.

Wesley, K. (2000). The ill-effects of the five paragraph theme. English Journal, 90 (1), 57–60.

Wiley, M. (2000). The popularity of formulaic writing (and why we need to resist). English Journal, 90 (1), 61–67.

ASCD is a community dedicated to educators' professional growth and well-being.

Let us help you put your vision into action., from our issue.

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

• View all journals
• My Account Login
• Explore content
• About the journal
• Publish with us
• Sign up for alerts
• Open access
• Published: 03 June 2024

Applying large language models for automated essay scoring for non-native Japanese

• Wenchao Li 1 &
• Haitao Liu 2  

Humanities and Social Sciences Communications volume  11 , Article number:  723 ( 2024 ) Cite this article

129 Accesses

1 Altmetric

Metrics details

• Language and linguistics

Recent advancements in artificial intelligence (AI) have led to an increased use of large language models (LLMs) for language assessment tasks such as automated essay scoring (AES), automated listening tests, and automated oral proficiency assessments. The application of LLMs for AES in the context of non-native Japanese, however, remains limited. This study explores the potential of LLM-based AES by comparing the efficiency of different models, i.e. two conventional machine training technology-based methods (Jess and JWriter), two LLMs (GPT and BERT), and one Japanese local LLM (Open-Calm large model). To conduct the evaluation, a dataset consisting of 1400 story-writing scripts authored by learners with 12 different first languages was used. Statistical analysis revealed that GPT-4 outperforms Jess and JWriter, BERT, and the Japanese language-specific trained Open-Calm large model in terms of annotation accuracy and predicting learning levels. Furthermore, by comparing 18 different models that utilize various prompts, the study emphasized the significance of prompts in achieving accurate and reliable evaluations using LLMs.

Similar content being viewed by others

Accurate structure prediction of biomolecular interactions with AlphaFold 3

Testing theory of mind in large language models and humans

Highly accurate protein structure prediction with AlphaFold

Conventional machine learning technology in aes.

AES has experienced significant growth with the advancement of machine learning technologies in recent decades. In the earlier stages of AES development, conventional machine learning-based approaches were commonly used. These approaches involved the following procedures: a) feeding the machine with a dataset. In this step, a dataset of essays is provided to the machine learning system. The dataset serves as the basis for training the model and establishing patterns and correlations between linguistic features and human ratings. b) the machine learning model is trained using linguistic features that best represent human ratings and can effectively discriminate learners’ writing proficiency. These features include lexical richness (Lu, 2012 ; Kyle and Crossley, 2015 ; Kyle et al. 2021 ), syntactic complexity (Lu, 2010 ; Liu, 2008 ), text cohesion (Crossley and McNamara, 2016 ), and among others. Conventional machine learning approaches in AES require human intervention, such as manual correction and annotation of essays. This human involvement was necessary to create a labeled dataset for training the model. Several AES systems have been developed using conventional machine learning technologies. These include the Intelligent Essay Assessor (Landauer et al. 2003 ), the e-rater engine by Educational Testing Service (Attali and Burstein, 2006 ; Burstein, 2003 ), MyAccess with the InterlliMetric scoring engine by Vantage Learning (Elliot, 2003 ), and the Bayesian Essay Test Scoring system (Rudner and Liang, 2002 ). These systems have played a significant role in automating the essay scoring process and providing quick and consistent feedback to learners. However, as touched upon earlier, conventional machine learning approaches rely on predetermined linguistic features and often require manual intervention, making them less flexible and potentially limiting their generalizability to different contexts.

In the context of the Japanese language, conventional machine learning-incorporated AES tools include Jess (Ishioka and Kameda, 2006 ) and JWriter (Lee and Hasebe, 2017 ). Jess assesses essays by deducting points from the perfect score, utilizing the Mainichi Daily News newspaper as a database. The evaluation criteria employed by Jess encompass various aspects, such as rhetorical elements (e.g., reading comprehension, vocabulary diversity, percentage of complex words, and percentage of passive sentences), organizational structures (e.g., forward and reverse connection structures), and content analysis (e.g., latent semantic indexing). JWriter employs linear regression analysis to assign weights to various measurement indices, such as average sentence length and total number of characters. These weights are then combined to derive the overall score. A pilot study involving the Jess model was conducted on 1320 essays at different proficiency levels, including primary, intermediate, and advanced. However, the results indicated that the Jess model failed to significantly distinguish between these essay levels. Out of the 16 measures used, four measures, namely median sentence length, median clause length, median number of phrases, and maximum number of phrases, did not show statistically significant differences between the levels. Additionally, two measures exhibited between-level differences but lacked linear progression: the number of attributives declined words and the Kanji/kana ratio. On the other hand, the remaining measures, including maximum sentence length, maximum clause length, number of attributive conjugated words, maximum number of consecutive infinitive forms, maximum number of conjunctive-particle clauses, k characteristic value, percentage of big words, and percentage of passive sentences, demonstrated statistically significant between-level differences and displayed linear progression.

Both Jess and JWriter exhibit notable limitations, including the manual selection of feature parameters and weights, which can introduce biases into the scoring process. The reliance on human annotators to label non-native language essays also introduces potential noise and variability in the scoring. Furthermore, an important concern is the possibility of system manipulation and cheating by learners who are aware of the regression equation utilized by the models (Hirao et al. 2020 ). These limitations emphasize the need for further advancements in AES systems to address these challenges.

Deep learning technology in AES

Deep learning has emerged as one of the approaches for improving the accuracy and effectiveness of AES. Deep learning-based AES methods utilize artificial neural networks that mimic the human brain’s functioning through layered algorithms and computational units. Unlike conventional machine learning, deep learning autonomously learns from the environment and past errors without human intervention. This enables deep learning models to establish nonlinear correlations, resulting in higher accuracy. Recent advancements in deep learning have led to the development of transformers, which are particularly effective in learning text representations. Noteworthy examples include bidirectional encoder representations from transformers (BERT) (Devlin et al. 2019 ) and the generative pretrained transformer (GPT) (OpenAI).

BERT is a linguistic representation model that utilizes a transformer architecture and is trained on two tasks: masked linguistic modeling and next-sentence prediction (Hirao et al. 2020 ; Vaswani et al. 2017 ). In the context of AES, BERT follows specific procedures, as illustrated in Fig. 1 : (a) the tokenized prompts and essays are taken as input; (b) special tokens, such as [CLS] and [SEP], are added to mark the beginning and separation of prompts and essays; (c) the transformer encoder processes the prompt and essay sequences, resulting in hidden layer sequences; (d) the hidden layers corresponding to the [CLS] tokens (T[CLS]) represent distributed representations of the prompts and essays; and (e) a multilayer perceptron uses these distributed representations as input to obtain the final score (Hirao et al. 2020 ).

AES system with BERT (Hirao et al. 2020 ).

The training of BERT using a substantial amount of sentence data through the Masked Language Model (MLM) allows it to capture contextual information within the hidden layers. Consequently, BERT is expected to be capable of identifying artificial essays as invalid and assigning them lower scores (Mizumoto and Eguchi, 2023 ). In the context of AES for nonnative Japanese learners, Hirao et al. ( 2020 ) combined the long short-term memory (LSTM) model proposed by Hochreiter and Schmidhuber ( 1997 ) with BERT to develop a tailored automated Essay Scoring System. The findings of their study revealed that the BERT model outperformed both the conventional machine learning approach utilizing character-type features such as “kanji” and “hiragana”, as well as the standalone LSTM model. Takeuchi et al. ( 2021 ) presented an approach to Japanese AES that eliminates the requirement for pre-scored essays by relying solely on reference texts or a model answer for the essay task. They investigated multiple similarity evaluation methods, including frequency of morphemes, idf values calculated on Wikipedia, LSI, LDA, word-embedding vectors, and document vectors produced by BERT. The experimental findings revealed that the method utilizing the frequency of morphemes with idf values exhibited the strongest correlation with human-annotated scores across different essay tasks. The utilization of BERT in AES encounters several limitations. Firstly, essays often exceed the model’s maximum length limit. Second, only score labels are available for training, which restricts access to additional information.

Mizumoto and Eguchi ( 2023 ) were pioneers in employing the GPT model for AES in non-native English writing. Their study focused on evaluating the accuracy and reliability of AES using the GPT-3 text-davinci-003 model, analyzing a dataset of 12,100 essays from the corpus of nonnative written English (TOEFL11). The findings indicated that AES utilizing the GPT-3 model exhibited a certain degree of accuracy and reliability. They suggest that GPT-3-based AES systems hold the potential to provide support for human ratings. However, applying GPT model to AES presents a unique natural language processing (NLP) task that involves considerations such as nonnative language proficiency, the influence of the learner’s first language on the output in the target language, and identifying linguistic features that best indicate writing quality in a specific language. These linguistic features may differ morphologically or syntactically from those present in the learners’ first language, as observed in (1)–(3).

我-送了-他-一本-书

Wǒ-sòngle-tā-yī běn-shū

1 sg .-give. past- him-one .cl- book

“I gave him a book.”

Agglutinative

彼-に-本-を-あげ-まし-た

Kare-ni-hon-o-age-mashi-ta

3 sg .- dat -hon- acc- give.honorification. past

Inflectional

give, give-s, gave, given, giving

Additionally, the morphological agglutination and subject-object-verb (SOV) order in Japanese, along with its idiomatic expressions, pose additional challenges for applying language models in AES tasks (4).

足-が 棒-に なり-ました

Ashi-ga bo-ni nar-mashita

leg- nom stick- dat become- past

“My leg became like a stick (I am extremely tired).”

The example sentence provided demonstrates the morpho-syntactic structure of Japanese and the presence of an idiomatic expression. In this sentence, the verb “なる” (naru), meaning “to become”, appears at the end of the sentence. The verb stem “なり” (nari) is attached with morphemes indicating honorification (“ます” - mashu) and tense (“た” - ta), showcasing agglutination. While the sentence can be literally translated as “my leg became like a stick”, it carries an idiomatic interpretation that implies “I am extremely tired”.

To overcome this issue, CyberAgent Inc. ( 2023 ) has developed the Open-Calm series of language models specifically designed for Japanese. Open-Calm consists of pre-trained models available in various sizes, such as Small, Medium, Large, and 7b. Figure 2 depicts the fundamental structure of the Open-Calm model. A key feature of this architecture is the incorporation of the Lora Adapter and GPT-NeoX frameworks, which can enhance its language processing capabilities.

GPT-NeoX Model Architecture (Okgetheng and Takeuchi 2024 ).

In a recent study conducted by Okgetheng and Takeuchi ( 2024 ), they assessed the efficacy of Open-Calm language models in grading Japanese essays. The research utilized a dataset of approximately 300 essays, which were annotated by native Japanese educators. The findings of the study demonstrate the considerable potential of Open-Calm language models in automated Japanese essay scoring. Specifically, among the Open-Calm family, the Open-Calm Large model (referred to as OCLL) exhibited the highest performance. However, it is important to note that, as of the current date, the Open-Calm Large model does not offer public access to its server. Consequently, users are required to independently deploy and operate the environment for OCLL. In order to utilize OCLL, users must have a PC equipped with an NVIDIA GeForce RTX 3060 (8 or 12 GB VRAM).

In summary, while the potential of LLMs in automated scoring of nonnative Japanese essays has been demonstrated in two studies—BERT-driven AES (Hirao et al. 2020 ) and OCLL-based AES (Okgetheng and Takeuchi, 2024 )—the number of research efforts in this area remains limited.

Another significant challenge in applying LLMs to AES lies in prompt engineering and ensuring its reliability and effectiveness (Brown et al. 2020 ; Rae et al. 2021 ; Zhang et al. 2021 ). Various prompting strategies have been proposed, such as the zero-shot chain of thought (CoT) approach (Kojima et al. 2022 ), which involves manually crafting diverse and effective examples. However, manual efforts can lead to mistakes. To address this, Zhang et al. ( 2021 ) introduced an automatic CoT prompting method called Auto-CoT, which demonstrates matching or superior performance compared to the CoT paradigm. Another prompt framework is trees of thoughts, enabling a model to self-evaluate its progress at intermediate stages of problem-solving through deliberate reasoning (Yao et al. 2023 ).

Beyond linguistic studies, there has been a noticeable increase in the number of foreign workers in Japan and Japanese learners worldwide (Ministry of Health, Labor, and Welfare of Japan, 2022 ; Japan Foundation, 2021 ). However, existing assessment methods, such as the Japanese Language Proficiency Test (JLPT), J-CAT, and TTBJ Footnote 1 , primarily focus on reading, listening, vocabulary, and grammar skills, neglecting the evaluation of writing proficiency. As the number of workers and language learners continues to grow, there is a rising demand for an efficient AES system that can reduce costs and time for raters and be utilized for employment, examinations, and self-study purposes.

This study aims to explore the potential of LLM-based AES by comparing the effectiveness of five models: two LLMs (GPT Footnote 2 and BERT), one Japanese local LLM (OCLL), and two conventional machine learning-based methods (linguistic feature-based scoring tools - Jess and JWriter).

The research questions addressed in this study are as follows:

To what extent do the LLM-driven AES and linguistic feature-based AES, when used as automated tools to support human rating, accurately reflect test takers’ actual performance?

What influence does the prompt have on the accuracy and performance of LLM-based AES methods?

The subsequent sections of the manuscript cover the methodology, including the assessment measures for nonnative Japanese writing proficiency, criteria for prompts, and the dataset. The evaluation section focuses on the analysis of annotations and rating scores generated by LLM-driven and linguistic feature-based AES methods.

Methodology

The dataset utilized in this study was obtained from the International Corpus of Japanese as a Second Language (I-JAS) Footnote 3 . This corpus consisted of 1000 participants who represented 12 different first languages. For the study, the participants were given a story-writing task on a personal computer. They were required to write two stories based on the 4-panel illustrations titled “Picnic” and “The key” (see Appendix A). Background information for the participants was provided by the corpus, including their Japanese language proficiency levels assessed through two online tests: J-CAT and SPOT. These tests evaluated their reading, listening, vocabulary, and grammar abilities. The learners’ proficiency levels were categorized into six levels aligned with the Common European Framework of Reference for Languages (CEFR) and the Reference Framework for Japanese Language Education (RFJLE): A1, A2, B1, B2, C1, and C2. According to Lee et al. ( 2015 ), there is a high level of agreement (r = 0.86) between the J-CAT and SPOT assessments, indicating that the proficiency certifications provided by J-CAT are consistent with those of SPOT. However, it is important to note that the scores of J-CAT and SPOT do not have a one-to-one correspondence. In this study, the J-CAT scores were used as a benchmark to differentiate learners of different proficiency levels. A total of 1400 essays were utilized, representing the beginner (aligned with A1), A2, B1, B2, C1, and C2 levels based on the J-CAT scores. Table 1 provides information about the learners’ proficiency levels and their corresponding J-CAT and SPOT scores.

A dataset comprising a total of 1400 essays from the story writing tasks was collected. Among these, 714 essays were utilized to evaluate the reliability of the LLM-based AES method, while the remaining 686 essays were designated as development data to assess the LLM-based AES’s capability to distinguish participants with varying proficiency levels. The GPT 4 API was used in this study. A detailed explanation of the prompt-assessment criteria is provided in Section Prompt . All essays were sent to the model for measurement and scoring.

Measures of writing proficiency for nonnative Japanese

Japanese exhibits a morphologically agglutinative structure where morphemes are attached to the word stem to convey grammatical functions such as tense, aspect, voice, and honorifics, e.g. (5).

食べ-させ-られ-まし-た-か

tabe-sase-rare-mashi-ta-ka

[eat (stem)-causative-passive voice-honorification-tense. past-question marker]

Japanese employs nine case particles to indicate grammatical functions: the nominative case particle が (ga), the accusative case particle を (o), the genitive case particle の (no), the dative case particle に (ni), the locative/instrumental case particle で (de), the ablative case particle から (kara), the directional case particle へ (e), and the comitative case particle と (to). The agglutinative nature of the language, combined with the case particle system, provides an efficient means of distinguishing between active and passive voice, either through morphemes or case particles, e.g. 食べる taberu “eat concusive . ” (active voice); 食べられる taberareru “eat concusive . ” (passive voice). In the active voice, “パン を 食べる” (pan o taberu) translates to “to eat bread”. On the other hand, in the passive voice, it becomes “パン が 食べられた” (pan ga taberareta), which means “(the) bread was eaten”. Additionally, it is important to note that different conjugations of the same lemma are considered as one type in order to ensure a comprehensive assessment of the language features. For example, e.g., 食べる taberu “eat concusive . ”; 食べている tabeteiru “eat progress .”; 食べた tabeta “eat past . ” as one type.

To incorporate these features, previous research (Suzuki, 1999 ; Watanabe et al. 1988 ; Ishioka, 2001 ; Ishioka and Kameda, 2006 ; Hirao et al. 2020 ) has identified complexity, fluency, and accuracy as crucial factors for evaluating writing quality. These criteria are assessed through various aspects, including lexical richness (lexical density, diversity, and sophistication), syntactic complexity, and cohesion (Kyle et al. 2021 ; Mizumoto and Eguchi, 2023 ; Ure, 1971 ; Halliday, 1985 ; Barkaoui and Hadidi, 2020 ; Zenker and Kyle, 2021 ; Kim et al. 2018 ; Lu, 2017 ; Ortega, 2015 ). Therefore, this study proposes five scoring categories: lexical richness, syntactic complexity, cohesion, content elaboration, and grammatical accuracy. A total of 16 measures were employed to capture these categories. The calculation process and specific details of these measures can be found in Table 2 .

T-unit, first introduced by Hunt ( 1966 ), is a measure used for evaluating speech and composition. It serves as an indicator of syntactic development and represents the shortest units into which a piece of discourse can be divided without leaving any sentence fragments. In the context of Japanese language assessment, Sakoda and Hosoi ( 2020 ) utilized T-unit as the basic unit to assess the accuracy and complexity of Japanese learners’ speaking and storytelling. The calculation of T-units in Japanese follows the following principles:

A single main clause constitutes 1 T-unit, regardless of the presence or absence of dependent clauses, e.g. (6).

ケンとマリはピクニックに行きました (main clause): 1 T-unit.

If a sentence contains a main clause along with subclauses, each subclause is considered part of the same T-unit, e.g. (7).

天気が良かった の で (subclause)、ケンとマリはピクニックに行きました (main clause): 1 T-unit.

In the case of coordinate clauses, where multiple clauses are connected, each coordinated clause is counted separately. Thus, a sentence with coordinate clauses may have 2 T-units or more, e.g. (8).

ケンは地図で場所を探して (coordinate clause)、マリはサンドイッチを作りました (coordinate clause): 2 T-units.

Lexical diversity refers to the range of words used within a text (Engber, 1995 ; Kyle et al. 2021 ) and is considered a useful measure of the breadth of vocabulary in L n production (Jarvis, 2013a , 2013b ).

The type/token ratio (TTR) is widely recognized as a straightforward measure for calculating lexical diversity and has been employed in numerous studies. These studies have demonstrated a strong correlation between TTR and other methods of measuring lexical diversity (e.g., Bentz et al. 2016 ; Čech and Miroslav, 2018 ; Çöltekin and Taraka, 2018 ). TTR is computed by considering both the number of unique words (types) and the total number of words (tokens) in a given text. Given that the length of learners’ writing texts can vary, this study employs the moving average type-token ratio (MATTR) to mitigate the influence of text length. MATTR is calculated using a 50-word moving window. Initially, a TTR is determined for words 1–50 in an essay, followed by words 2–51, 3–52, and so on until the end of the essay is reached (Díez-Ortega and Kyle, 2023 ). The final MATTR scores were obtained by averaging the TTR scores for all 50-word windows. The following formula was employed to derive MATTR:

\({\rm{MATTR}}({\rm{W}})=\frac{{\sum }_{{\rm{i}}=1}^{{\rm{N}}-{\rm{W}}+1}{{\rm{F}}}_{{\rm{i}}}}{{\rm{W}}({\rm{N}}-{\rm{W}}+1)}\)

Here, N refers to the number of tokens in the corpus. W is the randomly selected token size (W < N). \({F}_{i}\) is the number of types in each window. The \({\rm{MATTR}}({\rm{W}})\) is the mean of a series of type-token ratios (TTRs) based on the word form for all windows. It is expected that individuals with higher language proficiency will produce texts with greater lexical diversity, as indicated by higher MATTR scores.

Lexical density was captured by the ratio of the number of lexical words to the total number of words (Lu, 2012 ). Lexical sophistication refers to the utilization of advanced vocabulary, often evaluated through word frequency indices (Crossley et al. 2013 ; Haberman, 2008 ; Kyle and Crossley, 2015 ; Laufer and Nation, 1995 ; Lu, 2012 ; Read, 2000 ). In line of writing, lexical sophistication can be interpreted as vocabulary breadth, which entails the appropriate usage of vocabulary items across various lexicon-grammatical contexts and registers (Garner et al. 2019 ; Kim et al. 2018 ; Kyle et al. 2018 ). In Japanese specifically, words are considered lexically sophisticated if they are not included in the “Japanese Education Vocabulary List Ver 1.0”. Footnote 4 Consequently, lexical sophistication was calculated by determining the number of sophisticated word types relative to the total number of words per essay. Furthermore, it has been suggested that, in Japanese writing, sentences should ideally have a length of no more than 40 to 50 characters, as this promotes readability. Therefore, the median and maximum sentence length can be considered as useful indices for assessment (Ishioka and Kameda, 2006 ).

Syntactic complexity was assessed based on several measures, including the mean length of clauses, verb phrases per T-unit, clauses per T-unit, dependent clauses per T-unit, complex nominals per clause, adverbial clauses per clause, coordinate phrases per clause, and mean dependency distance (MDD). The MDD reflects the distance between the governor and dependent positions in a sentence. A larger dependency distance indicates a higher cognitive load and greater complexity in syntactic processing (Liu, 2008 ; Liu et al. 2017 ). The MDD has been established as an efficient metric for measuring syntactic complexity (Jiang, Quyang, and Liu, 2019 ; Li and Yan, 2021 ). To calculate the MDD, the position numbers of the governor and dependent are subtracted, assuming that words in a sentence are assigned in a linear order, such as W1 … Wi … Wn. In any dependency relationship between words Wa and Wb, Wa is the governor and Wb is the dependent. The MDD of the entire sentence was obtained by taking the absolute value of governor – dependent:

MDD = \(\frac{1}{n}{\sum }_{i=1}^{n}|{\rm{D}}{{\rm{D}}}_{i}|\)

In this formula, \(n\) represents the number of words in the sentence, and \({DD}i\) is the dependency distance of the \({i}^{{th}}\) dependency relationship of a sentence. Building on this, the annotation of sentence ‘Mary-ga-John-ni-keshigomu-o-watashita was [Mary- top -John- dat -eraser- acc -give- past] ’. The sentence’s MDD would be 2. Table 3 provides the CSV file as a prompt for GPT 4.

Cohesion (semantic similarity) and content elaboration aim to capture the ideas presented in test taker’s essays. Cohesion was assessed using three measures: Synonym overlap/paragraph (topic), Synonym overlap/paragraph (keywords), and word2vec cosine similarity. Content elaboration and development were measured as the number of metadiscourse markers (type)/number of words. To capture content closely, this study proposed a novel-distance based representation, by encoding the cosine distance between the essay (by learner) and essay task’s (topic and keyword) i -vectors. The learner’s essay is decoded into a word sequence, and aligned to the essay task’ topic and keyword for log-likelihood measurement. The cosine distance reveals the content elaboration score in the leaners’ essay. The mathematical equation of cosine similarity between target-reference vectors is shown in (11), assuming there are i essays and ( L i , …. L n ) and ( N i , …. N n ) are the vectors representing the learner and task’s topic and keyword respectively. The content elaboration distance between L i and N i was calculated as follows:

\(\cos \left(\theta \right)=\frac{{\rm{L}}\,\cdot\, {\rm{N}}}{\left|{\rm{L}}\right|{\rm{|N|}}}=\frac{\mathop{\sum }\nolimits_{i=1}^{n}{L}_{i}{N}_{i}}{\sqrt{\mathop{\sum }\nolimits_{i=1}^{n}{L}_{i}^{2}}\sqrt{\mathop{\sum }\nolimits_{i=1}^{n}{N}_{i}^{2}}}\)

A high similarity value indicates a low difference between the two recognition outcomes, which in turn suggests a high level of proficiency in content elaboration.

To evaluate the effectiveness of the proposed measures in distinguishing different proficiency levels among nonnative Japanese speakers’ writing, we conducted a multi-faceted Rasch measurement analysis (Linacre, 1994 ). This approach applies measurement models to thoroughly analyze various factors that can influence test outcomes, including test takers’ proficiency, item difficulty, and rater severity, among others. The underlying principles and functionality of multi-faceted Rasch measurement are illustrated in (12).

\(\log \left(\frac{{P}_{{nijk}}}{{P}_{{nij}(k-1)}}\right)={B}_{n}-{D}_{i}-{C}_{j}-{F}_{k}\)

(12) defines the logarithmic transformation of the probability ratio ( P nijk /P nij(k-1) )) as a function of multiple parameters. Here, n represents the test taker, i denotes a writing proficiency measure, j corresponds to the human rater, and k represents the proficiency score. The parameter B n signifies the proficiency level of test taker n (where n ranges from 1 to N). D j represents the difficulty parameter of test item i (where i ranges from 1 to L), while C j represents the severity of rater j (where j ranges from 1 to J). Additionally, F k represents the step difficulty for a test taker to move from score ‘k-1’ to k . P nijk refers to the probability of rater j assigning score k to test taker n for test item i . P nij(k-1) represents the likelihood of test taker n being assigned score ‘k-1’ by rater j for test item i . Each facet within the test is treated as an independent parameter and estimated within the same reference framework. To evaluate the consistency of scores obtained through both human and computer analysis, we utilized the Infit mean-square statistic. This statistic is a chi-square measure divided by the degrees of freedom and is weighted with information. It demonstrates higher sensitivity to unexpected patterns in responses to items near a person’s proficiency level (Linacre, 2002 ). Fit statistics are assessed based on predefined thresholds for acceptable fit. For the Infit MNSQ, which has a mean of 1.00, different thresholds have been suggested. Some propose stricter thresholds ranging from 0.7 to 1.3 (Bond et al. 2021 ), while others suggest more lenient thresholds ranging from 0.5 to 1.5 (Eckes, 2009 ). In this study, we adopted the criterion of 0.70–1.30 for the Infit MNSQ.

Moving forward, we can now proceed to assess the effectiveness of the 16 proposed measures based on five criteria for accurately distinguishing various levels of writing proficiency among non-native Japanese speakers. To conduct this evaluation, we utilized the development dataset from the I-JAS corpus, as described in Section Dataset . Table 4 provides a measurement report that presents the performance details of the 14 metrics under consideration. The measure separation was found to be 4.02, indicating a clear differentiation among the measures. The reliability index for the measure separation was 0.891, suggesting consistency in the measurement. Similarly, the person separation reliability index was 0.802, indicating the accuracy of the assessment in distinguishing between individuals. All 16 measures demonstrated Infit mean squares within a reasonable range, ranging from 0.76 to 1.28. The Synonym overlap/paragraph (topic) measure exhibited a relatively high outfit mean square of 1.46, although the Infit mean square falls within an acceptable range. The standard error for the measures ranged from 0.13 to 0.28, indicating the precision of the estimates.

Table 5 further illustrated the weights assigned to different linguistic measures for score prediction, with higher weights indicating stronger correlations between those measures and higher scores. Specifically, the following measures exhibited higher weights compared to others: moving average type token ratio per essay has a weight of 0.0391. Mean dependency distance had a weight of 0.0388. Mean length of clause, calculated by dividing the number of words by the number of clauses, had a weight of 0.0374. Complex nominals per T-unit, calculated by dividing the number of complex nominals by the number of T-units, had a weight of 0.0379. Coordinate phrases rate, calculated by dividing the number of coordinate phrases by the number of clauses, had a weight of 0.0325. Grammatical error rate, representing the number of errors per essay, had a weight of 0.0322.

Criteria (output indicator)

The criteria used to evaluate the writing ability in this study were based on CEFR, which follows a six-point scale ranging from A1 to C2. To assess the quality of Japanese writing, the scoring criteria from Table 6 were utilized. These criteria were derived from the IELTS writing standards and served as assessment guidelines and prompts for the written output.

A prompt is a question or detailed instruction that is provided to the model to obtain a proper response. After several pilot experiments, we decided to provide the measures (Section Measures of writing proficiency for nonnative Japanese ) as the input prompt and use the criteria (Section Criteria (output indicator) ) as the output indicator. Regarding the prompt language, considering that the LLM was tasked with rating Japanese essays, would prompt in Japanese works better Footnote 5 ? We conducted experiments comparing the performance of GPT-4 using both English and Japanese prompts. Additionally, we utilized the Japanese local model OCLL with Japanese prompts. Multiple trials were conducted using the same sample. Regardless of the prompt language used, we consistently obtained the same grading results with GPT-4, which assigned a grade of B1 to the writing sample. This suggested that GPT-4 is reliable and capable of producing consistent ratings regardless of the prompt language. On the other hand, when we used Japanese prompts with the Japanese local model “OCLL”, we encountered inconsistent grading results. Out of 10 attempts with OCLL, only 6 yielded consistent grading results (B1), while the remaining 4 showed different outcomes, including A1 and B2 grades. These findings indicated that the language of the prompt was not the determining factor for reliable AES. Instead, the size of the training data and the model parameters played crucial roles in achieving consistent and reliable AES results for the language model.

The following is the utilized prompt, which details all measures and requires the LLM to score the essays using holistic and trait scores.

Please evaluate Japanese essays written by Japanese learners and assign a score to each essay on a six-point scale, ranging from A1, A2, B1, B2, C1 to C2. Additionally, please provide trait scores and display the calculation process for each trait score. The scoring should be based on the following criteria:

Moving average type-token ratio.

Number of lexical words (token) divided by the total number of words per essay.

Number of sophisticated word types divided by the total number of words per essay.

Mean length of clause.

Verb phrases per T-unit.

Clauses per T-unit.

Dependent clauses per T-unit.

Complex nominals per clause.

Adverbial clauses per clause.

Coordinate phrases per clause.

Mean dependency distance.

Synonym overlap paragraph (topic and keywords).

Word2vec cosine similarity.

Connectives per essay.

Conjunctions per essay.

Number of metadiscourse markers (types) divided by the total number of words.

Number of errors per essay.

Japanese essay text

出かける前に二人が地図を見ている間に、サンドイッチを入れたバスケットに犬が入ってしまいました。それに気づかずに二人は楽しそうに出かけて行きました。やがて突然犬がバスケットから飛び出し、二人は驚きました。バスケット の 中を見ると、食べ物はすべて犬に食べられていて、二人は困ってしまいました。(ID_JJJ01_SW1)

The score of the example above was B1. Figure 3 provides an example of holistic and trait scores provided by GPT-4 (with a prompt indicating all measures) via Bing Footnote 6 .

Example of GPT-4 AES and feedback (with a prompt indicating all measures).

Statistical analysis

The aim of this study is to investigate the potential use of LLM for nonnative Japanese AES. It seeks to compare the scoring outcomes obtained from feature-based AES tools, which rely on conventional machine learning technology (i.e. Jess, JWriter), with those generated by AI-driven AES tools utilizing deep learning technology (BERT, GPT, OCLL). To assess the reliability of a computer-assisted annotation tool, the study initially established human-human agreement as the benchmark measure. Subsequently, the performance of the LLM-based method was evaluated by comparing it to human-human agreement.

To assess annotation agreement, the study employed standard measures such as precision, recall, and F-score (Brants 2000 ; Lu 2010 ), along with the quadratically weighted kappa (QWK) to evaluate the consistency and agreement in the annotation process. Assume A and B represent human annotators. When comparing the annotations of the two annotators, the following results are obtained. The evaluation of precision, recall, and F-score metrics was illustrated in equations (13) to (15).

\({\rm{Recall}}(A,B)=\frac{{\rm{Number}}\,{\rm{of}}\,{\rm{identical}}\,{\rm{nodes}}\,{\rm{in}}\,A\,{\rm{and}}\,B}{{\rm{Number}}\,{\rm{of}}\,{\rm{nodes}}\,{\rm{in}}\,A}\)

\({\rm{Precision}}(A,\,B)=\frac{{\rm{Number}}\,{\rm{of}}\,{\rm{identical}}\,{\rm{nodes}}\,{\rm{in}}\,A\,{\rm{and}}\,B}{{\rm{Number}}\,{\rm{of}}\,{\rm{nodes}}\,{\rm{in}}\,B}\)

The F-score is the harmonic mean of recall and precision:

\({\rm{F}}-{\rm{score}}=\frac{2* ({\rm{Precision}}* {\rm{Recall}})}{{\rm{Precision}}+{\rm{Recall}}}\)

The highest possible value of an F-score is 1.0, indicating perfect precision and recall, and the lowest possible value is 0, if either precision or recall are zero.

In accordance with Taghipour and Ng ( 2016 ), the calculation of QWK involves two steps:

Step 1: Construct a weight matrix W as follows:

\({W}_{{ij}}=\frac{{(i-j)}^{2}}{{(N-1)}^{2}}\)

i represents the annotation made by the tool, while j represents the annotation made by a human rater. N denotes the total number of possible annotations. Matrix O is subsequently computed, where O_( i, j ) represents the count of data annotated by the tool ( i ) and the human annotator ( j ). On the other hand, E refers to the expected count matrix, which undergoes normalization to ensure that the sum of elements in E matches the sum of elements in O.

Step 2: With matrices O and E, the QWK is obtained as follows:

K = 1- \(\frac{\sum i,j{W}_{i,j}\,{O}_{i,j}}{\sum i,j{W}_{i,j}\,{E}_{i,j}}\)

The value of the quadratic weighted kappa increases as the level of agreement improves. Further, to assess the accuracy of LLM scoring, the proportional reductive mean square error (PRMSE) was employed. The PRMSE approach takes into account the variability observed in human ratings to estimate the rater error, which is then subtracted from the variance of the human labels. This calculation provides an overall measure of agreement between the automated scores and true scores (Haberman et al. 2015 ; Loukina et al. 2020 ; Taghipour and Ng, 2016 ). The computation of PRMSE involves the following steps:

Step 1: Calculate the mean squared errors (MSEs) for the scoring outcomes of the computer-assisted tool (MSE tool) and the human scoring outcomes (MSE human).

Step 2: Determine the PRMSE by comparing the MSE of the computer-assisted tool (MSE tool) with the MSE from human raters (MSE human), using the following formula:

\({\rm{PRMSE}}=1-\frac{({\rm{MSE}}\,{\rm{tool}})\,}{({\rm{MSE}}\,{\rm{human}})\,}=1-\,\frac{{\sum }_{i}^{n}=1{({{\rm{y}}}_{i}-{\hat{{\rm{y}}}}_{{\rm{i}}})}^{2}}{{\sum }_{i}^{n}=1{({{\rm{y}}}_{i}-\hat{{\rm{y}}})}^{2}}\)

In the numerator, ŷi represents the scoring outcome predicted by a specific LLM-driven AES system for a given sample. The term y i − ŷ i represents the difference between this predicted outcome and the mean value of all LLM-driven AES systems’ scoring outcomes. It quantifies the deviation of the specific LLM-driven AES system’s prediction from the average prediction of all LLM-driven AES systems. In the denominator, y i − ŷ represents the difference between the scoring outcome provided by a specific human rater for a given sample and the mean value of all human raters’ scoring outcomes. It measures the discrepancy between the specific human rater’s score and the average score given by all human raters. The PRMSE is then calculated by subtracting the ratio of the MSE tool to the MSE human from 1. PRMSE falls within the range of 0 to 1, with larger values indicating reduced errors in LLM’s scoring compared to those of human raters. In other words, a higher PRMSE implies that LLM’s scoring demonstrates greater accuracy in predicting the true scores (Loukina et al. 2020 ). The interpretation of kappa values, ranging from 0 to 1, is based on the work of Landis and Koch ( 1977 ). Specifically, the following categories are assigned to different ranges of kappa values: −1 indicates complete inconsistency, 0 indicates random agreement, 0.0 ~ 0.20 indicates extremely low level of agreement (slight), 0.21 ~ 0.40 indicates moderate level of agreement (fair), 0.41 ~ 0.60 indicates medium level of agreement (moderate), 0.61 ~ 0.80 indicates high level of agreement (substantial), 0.81 ~ 1 indicates almost perfect level of agreement. All statistical analyses were executed using Python script.

Results and discussion

Annotation reliability of the llm.

This section focuses on assessing the reliability of the LLM’s annotation and scoring capabilities. To evaluate the reliability, several tests were conducted simultaneously, aiming to achieve the following objectives:

Assess the LLM’s ability to differentiate between test takers with varying levels of oral proficiency.

Determine the level of agreement between the annotations and scoring performed by the LLM and those done by human raters.

The evaluation of the results encompassed several metrics, including: precision, recall, F-Score, quadratically-weighted kappa, proportional reduction of mean squared error, Pearson correlation, and multi-faceted Rasch measurement.

Inter-annotator agreement (human–human annotator agreement)

We started with an agreement test of the two human annotators. Two trained annotators were recruited to determine the writing task data measures. A total of 714 scripts, as the test data, was utilized. Each analysis lasted 300–360 min. Inter-annotator agreement was evaluated using the standard measures of precision, recall, and F-score and QWK. Table 7 presents the inter-annotator agreement for the various indicators. As shown, the inter-annotator agreement was fairly high, with F-scores ranging from 1.0 for sentence and word number to 0.666 for grammatical errors.

The findings from the QWK analysis provided further confirmation of the inter-annotator agreement. The QWK values covered a range from 0.950 ( p  = 0.000) for sentence and word number to 0.695 for synonym overlap number (keyword) and grammatical errors ( p  = 0.001).

Agreement of annotation outcomes between human and LLM

To evaluate the consistency between human annotators and LLM annotators (BERT, GPT, OCLL) across the indices, the same test was conducted. The results of the inter-annotator agreement (F-score) between LLM and human annotation are provided in Appendix B-D. The F-scores ranged from 0.706 for Grammatical error # for OCLL-human to a perfect 1.000 for GPT-human, for sentences, clauses, T-units, and words. These findings were further supported by the QWK analysis, which showed agreement levels ranging from 0.807 ( p  = 0.001) for metadiscourse markers for OCLL-human to 0.962 for words ( p  = 0.000) for GPT-human. The findings demonstrated that the LLM annotation achieved a significant level of accuracy in identifying measurement units and counts.

Reliability of LLM-driven AES’s scoring and discriminating proficiency levels

This section examines the reliability of the LLM-driven AES scoring through a comparison of the scoring outcomes produced by human raters and the LLM ( Reliability of LLM-driven AES scoring ). It also assesses the effectiveness of the LLM-based AES system in differentiating participants with varying proficiency levels ( Reliability of LLM-driven AES discriminating proficiency levels ).

Reliability of LLM-driven AES scoring

Table 8 summarizes the QWK coefficient analysis between the scores computed by the human raters and the GPT-4 for the individual essays from I-JAS Footnote 7 . As shown, the QWK of all measures ranged from k  = 0.819 for lexical density (number of lexical words (tokens)/number of words per essay) to k  = 0.644 for word2vec cosine similarity. Table 9 further presents the Pearson correlations between the 16 writing proficiency measures scored by human raters and GPT 4 for the individual essays. The correlations ranged from 0.672 for syntactic complexity to 0.734 for grammatical accuracy. The correlations between the writing proficiency scores assigned by human raters and the BERT-based AES system were found to range from 0.661 for syntactic complexity to 0.713 for grammatical accuracy. The correlations between the writing proficiency scores given by human raters and the OCLL-based AES system ranged from 0.654 for cohesion to 0.721 for grammatical accuracy. These findings indicated an alignment between the assessments made by human raters and both the BERT-based and OCLL-based AES systems in terms of various aspects of writing proficiency.

Reliability of LLM-driven AES discriminating proficiency levels

After validating the reliability of the LLM’s annotation and scoring, the subsequent objective was to evaluate its ability to distinguish between various proficiency levels. For this analysis, a dataset of 686 individual essays was utilized. Table 10 presents a sample of the results, summarizing the means, standard deviations, and the outcomes of the one-way ANOVAs based on the measures assessed by the GPT-4 model. A post hoc multiple comparison test, specifically the Bonferroni test, was conducted to identify any potential differences between pairs of levels.

As the results reveal, seven measures presented linear upward or downward progress across the three proficiency levels. These were marked in bold in Table 10 and comprise one measure of lexical richness, i.e. MATTR (lexical diversity); four measures of syntactic complexity, i.e. MDD (mean dependency distance), MLC (mean length of clause), CNT (complex nominals per T-unit), CPC (coordinate phrases rate); one cohesion measure, i.e. word2vec cosine similarity and GER (grammatical error rate). Regarding the ability of the sixteen measures to distinguish adjacent proficiency levels, the Bonferroni tests indicated that statistically significant differences exist between the primary level and the intermediate level for MLC and GER. One measure of lexical richness, namely LD, along with three measures of syntactic complexity (VPT, CT, DCT, ACC), two measures of cohesion (SOPT, SOPK), and one measure of content elaboration (IMM), exhibited statistically significant differences between proficiency levels. However, these differences did not demonstrate a linear progression between adjacent proficiency levels. No significant difference was observed in lexical sophistication between proficiency levels.

To summarize, our study aimed to evaluate the reliability and differentiation capabilities of the LLM-driven AES method. For the first objective, we assessed the LLM’s ability to differentiate between test takers with varying levels of oral proficiency using precision, recall, F-Score, and quadratically-weighted kappa. Regarding the second objective, we compared the scoring outcomes generated by human raters and the LLM to determine the level of agreement. We employed quadratically-weighted kappa and Pearson correlations to compare the 16 writing proficiency measures for the individual essays. The results confirmed the feasibility of using the LLM for annotation and scoring in AES for nonnative Japanese. As a result, Research Question 1 has been addressed.

Comparison of BERT-, GPT-, OCLL-based AES, and linguistic-feature-based computation methods

This section aims to compare the effectiveness of five AES methods for nonnative Japanese writing, i.e. LLM-driven approaches utilizing BERT, GPT, and OCLL, linguistic feature-based approaches using Jess and JWriter. The comparison was conducted by comparing the ratings obtained from each approach with human ratings. All ratings were derived from the dataset introduced in Dataset . To facilitate the comparison, the agreement between the automated methods and human ratings was assessed using QWK and PRMSE. The performance of each approach was summarized in Table 11 .

The QWK coefficient values indicate that LLMs (GPT, BERT, OCLL) and human rating outcomes demonstrated higher agreement compared to feature-based AES methods (Jess and JWriter) in assessing writing proficiency criteria, including lexical richness, syntactic complexity, content, and grammatical accuracy. Among the LLMs, the GPT-4 driven AES and human rating outcomes showed the highest agreement in all criteria, except for syntactic complexity. The PRMSE values suggest that the GPT-based method outperformed linguistic feature-based methods and other LLM-based approaches. Moreover, an interesting finding emerged during the study: the agreement coefficient between GPT-4 and human scoring was even higher than the agreement between different human raters themselves. This discovery highlights the advantage of GPT-based AES over human rating. Ratings involve a series of processes, including reading the learners’ writing, evaluating the content and language, and assigning scores. Within this chain of processes, various biases can be introduced, stemming from factors such as rater biases, test design, and rating scales. These biases can impact the consistency and objectivity of human ratings. GPT-based AES may benefit from its ability to apply consistent and objective evaluation criteria. By prompting the GPT model with detailed writing scoring rubrics and linguistic features, potential biases in human ratings can be mitigated. The model follows a predefined set of guidelines and does not possess the same subjective biases that human raters may exhibit. This standardization in the evaluation process contributes to the higher agreement observed between GPT-4 and human scoring. Section Prompt strategy of the study delves further into the role of prompts in the application of LLMs to AES. It explores how the choice and implementation of prompts can impact the performance and reliability of LLM-based AES methods. Furthermore, it is important to acknowledge the strengths of the local model, i.e. the Japanese local model OCLL, which excels in processing certain idiomatic expressions. Nevertheless, our analysis indicated that GPT-4 surpasses local models in AES. This superior performance can be attributed to the larger parameter size of GPT-4, estimated to be between 500 billion and 1 trillion, which exceeds the sizes of both BERT and the local model OCLL.

Prompt strategy

In the context of prompt strategy, Mizumoto and Eguchi ( 2023 ) conducted a study where they applied the GPT-3 model to automatically score English essays in the TOEFL test. They found that the accuracy of the GPT model alone was moderate to fair. However, when they incorporated linguistic measures such as cohesion, syntactic complexity, and lexical features alongside the GPT model, the accuracy significantly improved. This highlights the importance of prompt engineering and providing the model with specific instructions to enhance its performance. In this study, a similar approach was taken to optimize the performance of LLMs. GPT-4, which outperformed BERT and OCLL, was selected as the candidate model. Model 1 was used as the baseline, representing GPT-4 without any additional prompting. Model 2, on the other hand, involved GPT-4 prompted with 16 measures that included scoring criteria, efficient linguistic features for writing assessment, and detailed measurement units and calculation formulas. The remaining models (Models 3 to 18) utilized GPT-4 prompted with individual measures. The performance of these 18 different models was assessed using the output indicators described in Section Criteria (output indicator) . By comparing the performances of these models, the study aimed to understand the impact of prompt engineering on the accuracy and effectiveness of GPT-4 in AES tasks.

Based on the PRMSE scores presented in Fig. 4 , it was observed that Model 1, representing GPT-4 without any additional prompting, achieved a fair level of performance. However, Model 2, which utilized GPT-4 prompted with all measures, outperformed all other models in terms of PRMSE score, achieving a score of 0.681. These results indicate that the inclusion of specific measures and prompts significantly enhanced the performance of GPT-4 in AES. Among the measures, syntactic complexity was found to play a particularly significant role in improving the accuracy of GPT-4 in assessing writing quality. Following that, lexical diversity emerged as another important factor contributing to the model’s effectiveness. The study suggests that a well-prompted GPT-4 can serve as a valuable tool to support human assessors in evaluating writing quality. By utilizing GPT-4 as an automated scoring tool, the evaluation biases associated with human raters can be minimized. This has the potential to empower teachers by allowing them to focus on designing writing tasks and guiding writing strategies, while leveraging the capabilities of GPT-4 for efficient and reliable scoring.

PRMSE scores of the 18 AES models.

This study aimed to investigate two main research questions: the feasibility of utilizing LLMs for AES and the impact of prompt engineering on the application of LLMs in AES.

To address the first objective, the study compared the effectiveness of five different models: GPT, BERT, the Japanese local LLM (OCLL), and two conventional machine learning-based AES tools (Jess and JWriter). The PRMSE values indicated that the GPT-4-based method outperformed other LLMs (BERT, OCLL) and linguistic feature-based computational methods (Jess and JWriter) across various writing proficiency criteria. Furthermore, the agreement coefficient between GPT-4 and human scoring surpassed the agreement among human raters themselves, highlighting the potential of using the GPT-4 tool to enhance AES by reducing biases and subjectivity, saving time, labor, and cost, and providing valuable feedback for self-study. Regarding the second goal, the role of prompt design was investigated by comparing 18 models, including a baseline model, a model prompted with all measures, and 16 models prompted with one measure at a time. GPT-4, which outperformed BERT and OCLL, was selected as the candidate model. The PRMSE scores of the models showed that GPT-4 prompted with all measures achieved the best performance, surpassing the baseline and other models.

In conclusion, this study has demonstrated the potential of LLMs in supporting human rating in assessments. By incorporating automation, we can save time and resources while reducing biases and subjectivity inherent in human rating processes. Automated language assessments offer the advantage of accessibility, providing equal opportunities and economic feasibility for individuals who lack access to traditional assessment centers or necessary resources. LLM-based language assessments provide valuable feedback and support to learners, aiding in the enhancement of their language proficiency and the achievement of their goals. This personalized feedback can cater to individual learner needs, facilitating a more tailored and effective language-learning experience.

There are three important areas that merit further exploration. First, prompt engineering requires attention to ensure optimal performance of LLM-based AES across different language types. This study revealed that GPT-4, when prompted with all measures, outperformed models prompted with fewer measures. Therefore, investigating and refining prompt strategies can enhance the effectiveness of LLMs in automated language assessments. Second, it is crucial to explore the application of LLMs in second-language assessment and learning for oral proficiency, as well as their potential in under-resourced languages. Recent advancements in self-supervised machine learning techniques have significantly improved automatic speech recognition (ASR) systems, opening up new possibilities for creating reliable ASR systems, particularly for under-resourced languages with limited data. However, challenges persist in the field of ASR. First, ASR assumes correct word pronunciation for automatic pronunciation evaluation, which proves challenging for learners in the early stages of language acquisition due to diverse accents influenced by their native languages. Accurately segmenting short words becomes problematic in such cases. Second, developing precise audio-text transcriptions for languages with non-native accented speech poses a formidable task. Last, assessing oral proficiency levels involves capturing various linguistic features, including fluency, pronunciation, accuracy, and complexity, which are not easily captured by current NLP technology.

Data availability

The dataset utilized was obtained from the International Corpus of Japanese as a Second Language (I-JAS). The data URLs: [ https://www2.ninjal.ac.jp/jll/lsaj/ihome2.html ].

J-CAT and TTBJ are two computerized adaptive tests used to assess Japanese language proficiency.

SPOT is a specific component of the TTBJ test.

J-CAT: https://www.j-cat2.org/html/ja/pages/interpret.html

SPOT: https://ttbj.cegloc.tsukuba.ac.jp/p1.html#SPOT .

The study utilized a prompt-based GPT-4 model, developed by OpenAI, which has an impressive architecture with 1.8 trillion parameters across 120 layers. GPT-4 was trained on a vast dataset of 13 trillion tokens, using two stages: initial training on internet text datasets to predict the next token, and subsequent fine-tuning through reinforcement learning from human feedback.

https://www2.ninjal.ac.jp/jll/lsaj/ihome2-en.html .

http://jhlee.sakura.ne.jp/JEV/ by Japanese Learning Dictionary Support Group 2015.

We express our sincere gratitude to the reviewer for bringing this matter to our attention.

On February 7, 2023, Microsoft began rolling out a major overhaul to Bing that included a new chatbot feature based on OpenAI’s GPT-4 (Bing.com).

Appendix E-F present the analysis results of the QWK coefficient between the scores computed by the human raters and the BERT, OCLL models.

Attali Y, Burstein J (2006) Automated essay scoring with e-rater® V.2. J. Technol., Learn. Assess., 4

Barkaoui K, Hadidi A (2020) Assessing Change in English Second Language Writing Performance (1st ed.). Routledge, New York. https://doi.org/10.4324/9781003092346

Bentz C, Tatyana R, Koplenig A, Tanja S (2016) A comparison between morphological complexity. measures: Typological data vs. language corpora. In Proceedings of the workshop on computational linguistics for linguistic complexity (CL4LC), 142–153. Osaka, Japan: The COLING 2016 Organizing Committee

Bond TG, Yan Z, Heene M (2021) Applying the Rasch model: Fundamental measurement in the human sciences (4th ed). Routledge

Brants T (2000) Inter-annotator agreement for a German newspaper corpus. Proceedings of the Second International Conference on Language Resources and Evaluation (LREC’00), Athens, Greece, 31 May-2 June, European Language Resources Association

Brown TB, Mann B, Ryder N, et al. (2020) Language models are few-shot learners. Advances in Neural Information Processing Systems, Online, 6–12 December, Curran Associates, Inc., Red Hook, NY

Burstein J (2003) The E-rater scoring engine: Automated essay scoring with natural language processing. In Shermis MD and Burstein JC (ed) Automated Essay Scoring: A Cross-Disciplinary Perspective. Lawrence Erlbaum Associates, Mahwah, NJ

Čech R, Miroslav K (2018) Morphological richness of text. In Masako F, Václav C (ed) Taming the corpus: From inflection and lexis to interpretation, 63–77. Cham, Switzerland: Springer Nature

Çöltekin Ç, Taraka, R (2018) Exploiting Universal Dependencies treebanks for measuring morphosyntactic complexity. In Aleksandrs B, Christian B (ed), Proceedings of first workshop on measuring language complexity, 1–7. Torun, Poland

Crossley SA, Cobb T, McNamara DS (2013) Comparing count-based and band-based indices of word frequency: Implications for active vocabulary research and pedagogical applications. System 41:965–981. https://doi.org/10.1016/j.system.2013.08.002

Article   Google Scholar  

Crossley SA, McNamara DS (2016) Say more and be more coherent: How text elaboration and cohesion can increase writing quality. J. Writ. Res. 7:351–370

CyberAgent Inc (2023) Open-Calm series of Japanese language models. Retrieved from: https://www.cyberagent.co.jp/news/detail/id=28817

Devlin J, Chang MW, Lee K, Toutanova K (2019) BERT: Pre-training of deep bidirectional transformers for language understanding. Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics, Minneapolis, Minnesota, 2–7 June, pp. 4171–4186. Association for Computational Linguistics

Diez-Ortega M, Kyle K (2023) Measuring the development of lexical richness of L2 Spanish: a longitudinal learner corpus study. Studies in Second Language Acquisition 1-31

Eckes T (2009) On common ground? How raters perceive scoring criteria in oral proficiency testing. In Brown A, Hill K (ed) Language testing and evaluation 13: Tasks and criteria in performance assessment (pp. 43–73). Peter Lang Publishing

Elliot S (2003) IntelliMetric: from here to validity. In: Shermis MD, Burstein JC (ed) Automated Essay Scoring: A Cross-Disciplinary Perspective. Lawrence Erlbaum Associates, Mahwah, NJ

Google Scholar  

Engber CA (1995) The relationship of lexical proficiency to the quality of ESL compositions. J. Second Lang. Writ. 4:139–155

Garner J, Crossley SA, Kyle K (2019) N-gram measures and L2 writing proficiency. System 80:176–187. https://doi.org/10.1016/j.system.2018.12.001

Haberman SJ (2008) When can subscores have value? J. Educat. Behav. Stat., 33:204–229

Haberman SJ, Yao L, Sinharay S (2015) Prediction of true test scores from observed item scores and ancillary data. Brit. J. Math. Stat. Psychol. 68:363–385

Halliday MAK (1985) Spoken and Written Language. Deakin University Press, Melbourne, Australia

Hirao R, Arai M, Shimanaka H et al. (2020) Automated essay scoring system for nonnative Japanese learners. Proceedings of the 12th Conference on Language Resources and Evaluation (LREC 2020), pp. 1250–1257. European Language Resources Association

Hunt KW (1966) Recent Measures in Syntactic Development. Elementary English, 43(7), 732–739. http://www.jstor.org/stable/41386067

Ishioka T (2001) About e-rater, a computer-based automatic scoring system for essays [Konpyūta ni yoru essei no jidō saiten shisutemu e − rater ni tsuite]. University Entrance Examination. Forum [Daigaku nyūshi fōramu] 24:71–76

Hochreiter S, Schmidhuber J (1997) Long short- term memory. Neural Comput. 9(8):1735–1780

Article   CAS   PubMed   Google Scholar  

Ishioka T, Kameda M (2006) Automated Japanese essay scoring system based on articles written by experts. Proceedings of the 21st International Conference on Computational Linguistics and 44th Annual Meeting of the Association for Computational Linguistics, Sydney, Australia, 17–18 July 2006, pp. 233-240. Association for Computational Linguistics, USA

Japan Foundation (2021) Retrieved from: https://www.jpf.gp.jp/j/project/japanese/survey/result/dl/survey2021/all.pdf

Jarvis S (2013a) Defining and measuring lexical diversity. In Jarvis S, Daller M (ed) Vocabulary knowledge: Human ratings and automated measures (Vol. 47, pp. 13–44). John Benjamins. https://doi.org/10.1075/sibil.47.03ch1

Jarvis S (2013b) Capturing the diversity in lexical diversity. Lang. Learn. 63:87–106. https://doi.org/10.1111/j.1467-9922.2012.00739.x

Jiang J, Quyang J, Liu H (2019) Interlanguage: A perspective of quantitative linguistic typology. Lang. Sci. 74:85–97

Kim M, Crossley SA, Kyle K (2018) Lexical sophistication as a multidimensional phenomenon: Relations to second language lexical proficiency, development, and writing quality. Mod. Lang. J. 102(1):120–141. https://doi.org/10.1111/modl.12447

Kojima T, Gu S, Reid M et al. (2022) Large language models are zero-shot reasoners. Advances in Neural Information Processing Systems, New Orleans, LA, 29 November-1 December, Curran Associates, Inc., Red Hook, NY

Kyle K, Crossley SA (2015) Automatically assessing lexical sophistication: Indices, tools, findings, and application. TESOL Q 49:757–786

Kyle K, Crossley SA, Berger CM (2018) The tool for the automatic analysis of lexical sophistication (TAALES): Version 2.0. Behav. Res. Methods 50:1030–1046. https://doi.org/10.3758/s13428-017-0924-4

Article   PubMed   Google Scholar  

Kyle K, Crossley SA, Jarvis S (2021) Assessing the validity of lexical diversity using direct judgements. Lang. Assess. Q. 18:154–170. https://doi.org/10.1080/15434303.2020.1844205

Landauer TK, Laham D, Foltz PW (2003) Automated essay scoring and annotation of essays with the Intelligent Essay Assessor. In Shermis MD, Burstein JC (ed), Automated Essay Scoring: A Cross-Disciplinary Perspective. Lawrence Erlbaum Associates, Mahwah, NJ

Landis JR, Koch GG (1977) The measurement of observer agreement for categorical data. Biometrics 159–174

Laufer B, Nation P (1995) Vocabulary size and use: Lexical richness in L2 written production. Appl. Linguist. 16:307–322. https://doi.org/10.1093/applin/16.3.307

Lee J, Hasebe Y (2017) jWriter Learner Text Evaluator, URL: https://jreadability.net/jwriter/

Lee J, Kobayashi N, Sakai T, Sakota K (2015) A Comparison of SPOT and J-CAT Based on Test Analysis [Tesuto bunseki ni motozuku ‘SPOT’ to ‘J-CAT’ no hikaku]. Research on the Acquisition of Second Language Japanese [Dainigengo to shite no nihongo no shūtoku kenkyū] (18) 53–69

Li W, Yan J (2021) Probability distribution of dependency distance based on a Treebank of. Japanese EFL Learners’ Interlanguage. J. Quant. Linguist. 28(2):172–186. https://doi.org/10.1080/09296174.2020.1754611

Article   MathSciNet   Google Scholar  

Linacre JM (2002) Optimizing rating scale category effectiveness. J. Appl. Meas. 3(1):85–106

PubMed   Google Scholar  

Linacre JM (1994) Constructing measurement with a Many-Facet Rasch Model. In Wilson M (ed) Objective measurement: Theory into practice, Volume 2 (pp. 129–144). Norwood, NJ: Ablex

Liu H (2008) Dependency distance as a metric of language comprehension difficulty. J. Cognitive Sci. 9:159–191

Liu H, Xu C, Liang J (2017) Dependency distance: A new perspective on syntactic patterns in natural languages. Phys. Life Rev. 21. https://doi.org/10.1016/j.plrev.2017.03.002

Loukina A, Madnani N, Cahill A, et al. (2020) Using PRMSE to evaluate automated scoring systems in the presence of label noise. Proceedings of the Fifteenth Workshop on Innovative Use of NLP for Building Educational Applications, Seattle, WA, USA → Online, 10 July, pp. 18–29. Association for Computational Linguistics

Lu X (2010) Automatic analysis of syntactic complexity in second language writing. Int. J. Corpus Linguist. 15:474–496

Lu X (2012) The relationship of lexical richness to the quality of ESL learners’ oral narratives. Mod. Lang. J. 96:190–208

Lu X (2017) Automated measurement of syntactic complexity in corpus-based L2 writing research and implications for writing assessment. Lang. Test. 34:493–511

Lu X, Hu R (2022) Sense-aware lexical sophistication indices and their relationship to second language writing quality. Behav. Res. Method. 54:1444–1460. https://doi.org/10.3758/s13428-021-01675-6

Ministry of Health, Labor, and Welfare of Japan (2022) Retrieved from: https://www.mhlw.go.jp/stf/newpage_30367.html

Mizumoto A, Eguchi M (2023) Exploring the potential of using an AI language model for automated essay scoring. Res. Methods Appl. Linguist. 3:100050

Okgetheng B, Takeuchi K (2024) Estimating Japanese Essay Grading Scores with Large Language Models. Proceedings of 30th Annual Conference of the Language Processing Society in Japan, March 2024

Ortega L (2015) Second language learning explained? SLA across 10 contemporary theories. In VanPatten B, Williams J (ed) Theories in Second Language Acquisition: An Introduction

Rae JW, Borgeaud S, Cai T, et al. (2021) Scaling Language Models: Methods, Analysis & Insights from Training Gopher. ArXiv, abs/2112.11446

Read J (2000) Assessing vocabulary. Cambridge University Press. https://doi.org/10.1017/CBO9780511732942

Rudner LM, Liang T (2002) Automated Essay Scoring Using Bayes’ Theorem. J. Technol., Learning and Assessment, 1 (2)

Sakoda K, Hosoi Y (2020) Accuracy and complexity of Japanese Language usage by SLA learners in different learning environments based on the analysis of I-JAS, a learners’ corpus of Japanese as L2. Math. Linguist. 32(7):403–418. https://doi.org/10.24701/mathling.32.7_403

Suzuki N (1999) Summary of survey results regarding comprehensive essay questions. Final report of “Joint Research on Comprehensive Examinations for the Aim of Evaluating Applicability to Each Specialized Field of Universities” for 1996-2000 [shōronbun sōgō mondai ni kansuru chōsa kekka no gaiyō. Heisei 8 - Heisei 12-nendo daigaku no kaku senmon bun’ya e no tekisei no hyōka o mokuteki to suru sōgō shiken no arikata ni kansuru kyōdō kenkyū’ saishū hōkoku-sho]. University Entrance Examination Section Center Research and Development Department [Daigaku nyūshi sentā kenkyū kaihatsubu], 21–32

Taghipour K, Ng HT (2016) A neural approach to automated essay scoring. Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, Austin, Texas, 1–5 November, pp. 1882–1891. Association for Computational Linguistics

Takeuchi K, Ohno M, Motojin K, Taguchi M, Inada Y, Iizuka M, Abo T, Ueda H (2021) Development of essay scoring methods based on reference texts with construction of research-available Japanese essay data. In IPSJ J 62(9):1586–1604

Ure J (1971) Lexical density: A computational technique and some findings. In Coultard M (ed) Talking about Text. English Language Research, University of Birmingham, Birmingham, England

Vaswani A, Shazeer N, Parmar N, et al. (2017) Attention is all you need. In Advances in Neural Information Processing Systems, Long Beach, CA, 4–7 December, pp. 5998–6008, Curran Associates, Inc., Red Hook, NY

Watanabe H, Taira Y, Inoue Y (1988) Analysis of essay evaluation data [Shōronbun hyōka dēta no kaiseki]. Bulletin of the Faculty of Education, University of Tokyo [Tōkyōdaigaku kyōiku gakubu kiyō], Vol. 28, 143–164

Yao S, Yu D, Zhao J, et al. (2023) Tree of thoughts: Deliberate problem solving with large language models. Advances in Neural Information Processing Systems, 36

Zenker F, Kyle K (2021) Investigating minimum text lengths for lexical diversity indices. Assess. Writ. 47:100505. https://doi.org/10.1016/j.asw.2020.100505

Zhang Y, Warstadt A, Li X, et al. (2021) When do you need billions of words of pretraining data? Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, Online, pp. 1112-1125. Association for Computational Linguistics. https://doi.org/10.18653/v1/2021.acl-long.90

Download references

This research was funded by National Foundation of Social Sciences (22BYY186) to Wenchao Li.

Author information

Authors and affiliations.

Department of Japanese Studies, Zhejiang University, Hangzhou, China

Department of Linguistics and Applied Linguistics, Zhejiang University, Hangzhou, China

You can also search for this author in PubMed   Google Scholar

Contributions

Wenchao Li is in charge of conceptualization, validation, formal analysis, investigation, data curation, visualization and writing the draft. Haitao Liu is in charge of supervision.

Corresponding author

Correspondence to Wenchao Li .

Ethics declarations

Competing interests.

The authors declare no competing interests.

Ethical approval

Ethical approval was not required as the study did not involve human participants.

Informed consent

This article does not contain any studies with human participants performed by any of the authors.

Additional information

Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

Supplemental material file #1, rights and permissions.

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ .

Reprints and permissions

About this article

Cite this article.

Li, W., Liu, H. Applying large language models for automated essay scoring for non-native Japanese. Humanit Soc Sci Commun 11 , 723 (2024). https://doi.org/10.1057/s41599-024-03209-9

Download citation

Received : 02 February 2024

Accepted : 16 May 2024

Published : 03 June 2024

DOI : https://doi.org/10.1057/s41599-024-03209-9

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

Quick links

• Explore articles by subject
• Guide to authors
• Editorial policies