Home | Community | Message Board


This site includes paid links. Please support our sponsors.


Welcome to the Shroomery Message Board! You are experiencing a small sample of what the site has to offer. Please login or register to post messages and view our exclusive members-only content. You'll gain access to additional forums, file attachments, board customizations, encrypted private messages, and much more!

Shop: PhytoExtractum Kratom Powder for Sale   Unfolding Nature Unfolding Nature: Being in the Implicate Order

Jump to first unread post Pages: 1
Offlinemorrowasted
Worldwide Stepper
Male User Gallery


Registered: 10/30/09
Posts: 31,378
Loc: House of Mirrors
Last seen: 17 days, 17 hours
Automated writing exam grading
    #19333257 - 12/27/13 02:51 PM (10 years, 1 month ago)

So my cousin's husband is doing a PhD in applied linguistics and his dissertation involves writing a computer program that will be used to automatically score the writing portion of the TOEFL exam. He claims that automated systems have actually been shown to have less scoring variation than systems that involve human graders. What do you think about this? :strokebeard:


Extras: Filter Print Post Top
Offlineandrewmurray86
Θεολογος
Male User Gallery


Folding@home Statistics
Registered: 02/05/13
Posts: 1,120
Loc: Hunter Valley, NSW Flag
Last seen: 6 years, 1 month
Re: Automated writing exam grading [Re: morrowasted]
    #19333266 - 12/27/13 02:54 PM (10 years, 1 month ago)

It would have be an amazingly complex system to understand any human language, especially English, probably one of the more complex languages out there.


Extras: Filter Print Post Top
Offlineandrewmurray86
Θεολογος
Male User Gallery


Folding@home Statistics
Registered: 02/05/13
Posts: 1,120
Loc: Hunter Valley, NSW Flag
Last seen: 6 years, 1 month
Re: Automated writing exam grading [Re: andrewmurray86]
    #19333285 - 12/27/13 02:57 PM (10 years, 1 month ago)

I mean, the idiosyncrasies of English, the ability of English to have puns and double entendres... Especially things like poetry and other writing intended to evoke emotions.

I'd be fascinated to see the end product.


Extras: Filter Print Post Top
Invisiblenooneman
Male

Registered: 04/24/09
Posts: 14,608
Loc: Utah
Re: Automated writing exam grading [Re: morrowasted]
    #19333300 - 12/27/13 02:59 PM (10 years, 1 month ago)

Automated grading systems have been around for a while, and they have known problems. Researchers have made some really cool nonsense papers that have been rigged to cheat automated paper grading systems. They're pure nonsense, but get perfect scores. It's pretty classic.


Extras: Filter Print Post Top
InvisibleMe_Roy
Stranger
Registered: 07/30/02
Posts: 3,230
Re: Automated writing exam grading [Re: nooneman]
    #19333312 - 12/27/13 03:03 PM (10 years, 1 month ago)

Quote:

nooneman said:
Automated grading systems have been around for a while, and they have known problems. Researchers have made some really cool nonsense papers that have been rigged to cheat automated paper grading systems. They're pure nonsense, but get perfect scores. It's pretty classic.




witness drkenny.


Extras: Filter Print Post Top
Invisiblebadchad
Mad Scientist

Registered: 03/02/05
Posts: 13,373
Re: Automated writing exam grading [Re: nooneman]
    #19333323 - 12/27/13 03:07 PM (10 years, 1 month ago)

I'd be cautiously skeptical but think such a system has potential.  I don't know anything about the content of the TOEFL, but would imagine an automated system would be most appropriate for an exam format with relatively short, concise, "closed" answers.


--------------------
...the whole experience is (and is as) a profound piece of knowledge.  It is an indellible experience; it is forever known.  I have known myself in a way I doubt I would have ever occurred except as it did.

Smith, P.  Bull. Menninger Clinic (1959) 23:20-27; p. 27.

...most subjects find the experience valuable, some find it frightening, and many say that is it uniquely lovely.

Osmond, H.  Annals, NY Acad Science (1957) 66:418-434; p.436


Extras: Filter Print Post Top
Offlinemorrowasted
Worldwide Stepper
Male User Gallery


Registered: 10/30/09
Posts: 31,378
Loc: House of Mirrors
Last seen: 17 days, 17 hours
Re: Automated writing exam grading [Re: badchad]
    #19338372 - 12/28/13 07:24 PM (10 years, 1 month ago)

Quote:

badchad said:
I'd be cautiously skeptical but think such a system has potential.  I don't know anything about the content of the TOEFL, but would imagine an automated system would be most appropriate for an exam format with relatively short, concise, "closed" answers.



The TOEFL is just a test for measuring one's ability to use English; it isn't interested in content. The program works, according to my understanding, by measuring the prescriptive grammatical accuracy and lexical complexity of the writing sample. The latter is accomplished by creating ratios; for example, writing sample A contains 5000 words. 500 of those words are "the"; thus 1 in 10 words is "the". 2000 of those words are nouns; 1000 are verbs, etc. 20 of those words contain 4 syllables. 5 words contain 5 syllables. These ratios generate a score of written complexity.

Don't get me wrong, I am also skeptical. I was told that by one of the philosophy professors at my school that the graduate department no longer considers the writing score from the GRE to be relevant because a portion of the grade is generated by an automated system.


Extras: Filter Print Post Top
Jump to top Pages: 1

Shop: PhytoExtractum Kratom Powder for Sale   Unfolding Nature Unfolding Nature: Being in the Implicate Order


Similar ThreadsPosterViewsRepliesLast post
* Final Exam *SECRET WEAPON* BloodNOil 1,860 15 06/29/05 12:21 AM
by dr0mni
* What do I need on my exam to pass Trig? VoidOfsPg 1,210 5 12/13/05 10:45 PM
by VoidOfsPg
* just cheated the fuck out of a chem exam... Madtowntripper 888 4 08/05/05 11:12 AM
by curiouskittin
* Help me motivate for my exam
( 1 2 3 4 5 6 all )
Colonel Kurtz Ph.D 5,557 100 09/08/05 11:44 AM
by Annom
* At least I only had one exam to fail
( 1 2 all )
Gillette 2,913 34 12/06/05 11:29 AM
by Cowgold
* Nothing Like Final Exams! Redstorm 1,189 12 12/08/03 11:08 PM
by MrBump
* why are writing lyrics so fucking hard to do?
( 1 2 all )
Delyrium 4,631 22 02/24/06 06:33 PM
by AliceDee
* Gonna bomb my tree exam today DNKYD 762 13 12/05/05 08:57 AM
by barfightlard

Extra information
You cannot start new topics / You cannot reply to topics
HTML is disabled / BBCode is enabled
Moderator: Entire Staff
355 topic views. 9 members, 40 guests and 37 web crawlers are browsing this forum.
[ Show Images Only | Sort by Score | Print Topic ]
Search this thread:

Copyright 1997-2024 Mind Media. Some rights reserved.

Generated in 0.028 seconds spending 0.008 seconds on 14 queries.