U.S. Jurisdictional Approaches to the Bar Exam During COVID-19: Why We Desperately Need Diploma Privilege
UPDATED 08/26 with this because the numbers are so horrifying that it needs to be at the top of the post:
CAN WE PLEASE DISCUSS THE FACT that Examsoft has not been used for a remote bar exam without major issue yet, even with just 1 jurisdiction/800 test takers (Michigan), and yet, 18 JURISDICTIONS plan to use it simultaneously to administer the test to OVER 30,000?! I just ran these test taker numbers (which are quite low, we're missing numbers from numerous jurisdictions offering remote examsoft bar exams) using a spreadsheet of info collected by the Diploma Privilege for Connecticut team and I'm frankly just...in jaw-dropping awe at this.
Let me run further math for you on that. 800 test takers on a remote bar exam in one jurisdiction (Michigan, that still had a significant issue when many users were locked out for 10-37 minutes on the first day of exams) is less than 3 PERCENT of the planned test takers who will be using examsoft to take remote bar exams on October 5-6. And again, those numbers are very low, as I don't have test taker numbers for Arizona, Idaho, Georgia, Massachusetts, Pennsylvania, Tennessee, or Texas (which alone historically has around 3,000 test takers!!).
THIS IS INSANE. THIS IS ABSOLUTELY RIDICULOUS. HOW CAN ANYONE THINK THIS IS REASONABLE OR GOING TO WORK.
When bar exam software has a significant issue the first time you use it in a remote setting, you don't go and then use it again for a remote use setting FOR OVER 37.5 TIMES THE PREVIOUS TEST TAKERS. This is BREATHTAKINGLY horrifying.
ORIGINALLY POSTED AUGUST 11, 2020
Quick Introduction (before getting into specific jurisdictional approaches):
The Normal Stress of the Bar Exam (pre-pandemic)
Let me start this out by noting that even in non-pandemic times, the process of studying for and taking the bar exam is an inherently stressful experience, both emotionally and financially. Each jurisdiction in the United States has different requirements for acquiring a legal license, but generally, you need: 1) a juris doctor degree acquired from a law school (a 3 year course full time and 4 years part time), 2) a passing grade in your jurisdiction on an ethics exam (often the Multistate Professional Responsibility Examination, or MPRE), 3) pass a Character and Fitness screening process/background check, and 4) pass the bar exam.
I’m not going to delve deeply into the huge expense of all of these items right now, but trust me when I say it’s a lot of money. The bar exam in Illinois, for example, costs $950 to take, and to properly prepare for it, you pretty much HAVE to pay for a professional bar prep program, which generally run $1,699+ (many of the big courses are over $2,000). It’s highly advised that you study full-time for the bar exam for around 2 months, and /don’t work/. The bar exam usually runs for 2-3 days and is only offered twice a year (and in some jurisdictions, only once a year). You generally won’t find out whether you passed or failed the bar exam for many weeks to many months afterward. If you don’t already have a job offer from a firm or an agency secured (contingent on you getting that licensure), you have to start job hunting without knowing whether you’ll be licensed or not. If you fail, you have to go through the whole process again, spending more money and time to pursue that passing score.
So even in the best of times, the bar exam process is incredibly expensive, stressful, and can cause a huge amount of financial hardship and uncertainty for test takers.
Bar Exams During a Pandemic
In the COVID-19 world we live in now, there are even more issues. Many jurisdictions have changed their bar exam plans multiple times, sometimes only a week or so before the original date. This causes a huge amount of mental and financial stress on test takers, as they now have to figure out how to support themselves for another 1-3 months until they can take the test.
Financial Concerns: Can they make their money last? Do they need to get a job to survive (against almost all bar prep advice)? If they search for a job, will they even be able to find one (there is a global recession on, after all)? If they already secured a job offer at a firm or an agency, is that offer still good (many businesses and governmental organizations have had to rescind their offers due to - recession, uncertainty of when law licenses will be acquired)? In some jurisdictions, like Delaware and Palau, the 2020 exam has been cancelled altogether, so test takers in those areas now have to figure out how they can make it through the next YEAR without a law license that will allow them to practice in their field.
Mental and Physical Health: Mental and emotional health issues are on the rise for everyone right now, given the pandemic and a global recession. Anyone who’s dealing with more immediate troubles, such as unemployment, illness or death in their families, and possible eviction, is going to be struggling even more. This constant stress and anxiety has a huge impact on a test taker’s ability to focus or study. In addition, the uncertainty behind when, where, and how a bar exam will be held means that it’s difficult for test takers to actually plan their studying (remember, several exams have been postponed or cancelled at the last minute). The bar exam tests such a wide variety of subjects that generally, test takers have to cram everything in their head over two months and hope that they reach the apex of that information curve right at the exam time, right before they forget it all (it’s basically impossible to hold on to all that knowledge for long). All the bar prep courses are designed to fit within that two month study period; what do you do when that two months extends to three, four, or five months? How do you retain what you’ve learned when you don’t know when those exams will happen?
Now let’s get into specific issues with each individual approach.
Quick disclaimer: I got almost all this information from the NCBE and plan to update it as I go with more information from various news sources. I don’t know the ins and outs of every jurisdiction, so there may be some outdated information on this. I am personally barred in Illinois, so I’m most familiar with the issues there. As you’ll see, this is a very complicated issue that jurisdictions are dealing with in a variety of different ways, and it’s all changing very quickly, so if anything is outdated or inaccurate, I apologize. You can always give me corrections via comment or via email at RachaelDickzen@gmail.com.
Almost all information here is from the National Conference of Bar Examiners, compiled 08/08/2020 from “July 2020 Bar Exam Status by Jurisdiction” (table form, broken out by date of exam)) and “July 2020 Bar Exam: Jurisdiction Information” (map and chart, broken out by jurisdiction)
UPDATED 08/11, 08/13, and 08/26 with new information [underlined, with sources linked]
Note 08/26: The Uniform Bar Examination is really catching on in recent years (seriously, I so wish this was adopted by Illinois when I took the bar exam there in 2015) and in normal times, test takers who pass the UBE can transfer their scores to other UBE jurisdictions, if their score is high enough (jurisdictions can set their own passing scores). It has now been adopted by 37 U.S. jurisdictions (out of 56). The NCBE is allowing two additional UBE test dates for jurisdictions offering it, but it appears that UBE scores will only be transferrable if they’re offered in person. If I say an exam is “for local admission only” that scores from that exam will not be transferrable to any other jurisdiction.
1. Jurisdictions who gave an in-person July bar exam
· Arkansas, Colorado, Iowa, Mississippi, Missouri, Montana, North Carolina, North Dakota, Northern Mariana Islands, Oklahoma, South Carolina, South Dakota, West Virginia, Wisconsin (UPDATED 08/13/2020: The Wisconsin bar exam was for test takers who went to out of state law schools. Graduates of in-state law schools automatically get diploma privilege in Wisconsin. One of my Phi Alpha Delta sisters Alicia Linzmeier also reported to me that someone in her testing room in Wisconsin reported COVID symptoms to the state supreme court but that the court did not notify anyone.)
Health Concerns: Bar exams, particularly in larger jurisdictions, often have hundreds (maybe even thousands?) of test takers in one large space, like a stadium or a conference center. Here’s a photo of what the bar exam looked like in Chicago when I took it in July 2015. Yes, it’s just as insanely intimidating as it looks. This was actually one of two locations for test takers in Chicago then.
Reports that have come in from various jurisdictions that gave in person July bar exams have been…concerning. All the usual pandemic concerns apply here: Is everyone there wearing a mask? Is social distancing being enforced? However, the very high stakes of a bar exam, the fact that this exam is offered only 1-2 times a year, and the huge expense and time commitment involved in studying for it means that there is a rather high incentive for test takers to go to take the bar exam even if they’re feeling sick or have tested positive for COVID-19. Although jurisdictions were taking test takers’ temperatures, it’s totally possible that someone was missed.
I also saw lots of reports from test takers that social distancing was NOT being enforced and that they were really uncomfortable with how close they were to other people but….what could they do? They really didn’t have any choice in the situation. Keep in mind most bar exams ban you from having a phone anywhere near you; you definitely have to leave it way far in the back of a room or sometimes even at home. There’s often no way to call for help or document what’s happening.
It’s a little too soon yet to determine if people got sick from in person bar exams yet, but there was a report that came out immediately after the Colorado bar exam indicating that a test taker had tested positive from COVID-19 that advised everyone in a specific room to get tested. And seriously, how can you concentrate on one of the most important tests in your life while you’re worrying about whether you’ve contracted a highly contagious disease that’s killed over 163,000 people in the US and whether you might now be carrying it home to your family?
Administrative Concerns: In pandemic times, you obviously can’t have that many people crammed into one room and certainly not that close together at tables, so you’ll need more rooms, more spaces, and more proctors to administer the exam. So you’re bringing in more people, more places, and more passing in hallways to get to the various locations. Administratively, it becomes even more complicated.
2. Jurisdictions planning to give a delayed in-person bar exam
· September – Puerto Rico (Although the NCBE website actually says that Puerto Rico gave its exam in July, I spoke with a lawyer in Puerto Rico on Saturday and found out that that is definitely NOT the case. Thanks for informing me, Irma Morales! Sorry, I haven’t been able to nail down the exact date yet because the website is all in Spanish, but I’ll try to figure this out soon).
· September 9-10 – Alaska, Guam, Hawaii, New Mexico
· September 30-October 1 – Maine, Rhode Island, Utah
· July and September 9-10 - Kansas, Minnesota, Nebraska, Virginia (one-day exam, Sept. 10), Washington
· July and September 30- October 1- Alabama, Wyoming
· July and October 5-6 - Arizona (updated 08/26: applicants could choose to attend the in person July exam, which would be eligible to transfer to other jurisdictions using the uniform bar exam [UBE] or a remote exam in October, but the remote exam would only be valid for practicing in Arizona), Idaho,
Health Concerns: All the previously stated in-person health and safety concerns apply here.
Mental Health and Studying Concerns: Given how many states have changed their plans for in person exams with extremely short notice, exam takers are in a huge state of uncertainty as to whether they will actually be taking the exam on the stated date or not, which leads to all the financial uncertainty and studying difficulty noted in the introduction.
3. Jurisdictions with multiple dates and multiple testing options
· Oct. 5-6 remote exam offered as an option in addition to in-person July - Arizona (Updated 08/26: the remote exam for local admission only), Idaho, Oregon (Updated 08/26: July in person exam [which was limited to a maximum seating capacity of 500 applicants], passing score reduced 8 points, October remote exam for local admission only)
· Oct. 5-6 remote exam offered as an option in addition to in-person Sept. exam - Texas (Updated 08/26: The Texas Board of Examiners said on August 24 that they will accept a score of 270 or higher earned on the October remote bar exam from the following jurisdictions: the District of Columbia, Connecticut, Illinois, Kentucky, Maryland, Massachusetts (Updated 08/26: has announced a potential backup of an open book exam), New Hampshire, New Jersey, New York, Ohio, Oregon, Tennessee, and Vermont)
4. Jurisdictions that gave a remote July bar exam
· July 28 - Michigan
Remote Exam Software Issues: Michigan is the only remote exam that’s been given so far, and thus, was the ONLY jurisdiction with a remote exam in July. It still had a ton of problems. The software crashed on the first day, which locked out some test takers for 10 - 37 minutes. Examsoft tried to blame this on a cyber attack, but many think this was an excuse and the software was simply just overwhelmed. The board of examiners said afterward that no data was compromised and test takers affected were given extra time, but that probably wasn’t very comforting to the many test takers who were anxiously freaking out at the time. Keep in mind that when a glitch in 2014 kept bar exam takers from being able to file their completed first-day tests electronically (after the bar exam, not during it), Examsoft ended up paying $2.1 million to settle all the class-action claims that resulted. This crash took place, DURING the bar exam, and all those test takers had to get right back to answering all the questions immediately after it happened. I can only imagine the panic attacks that were happening.
Updated 08/26: PLEASE REMEMBER that Examsoft crashed when it was offering just ONE bar exam. Numerous jurisdictions are currently planning to use Examsoft to offer simultaneous remote exams. This is a train wreck just waiting to happen. I have added a new category at the bottom of this post specifically outlining which jurisdiction is using Examsoft simultaneously.
Recently (as in August 7, 2020), a large bar exam software company, Extegrity, said that it will not be providing software for remote bar exams this year. They stated that their software was not developed for large scale, simultaneous start high stake exams and that remote proctoring carries undue risk for the October exam.
5. Jurisdictions planning to give a remote delayed bar exam (proctored)
· October 5-6 – California (lowered passing score 50 points. Updated 08/26: The new passing score will not be applied retroactively to previous bar examiners.), Connecticut, District of Columbia, Georgia, Illinois, Kentucky, Maryland, Massachusetts (Updated 08/26: has announced a potential backup of an open book exam), New Hampshire, New Jersey, New York, Ohio, Pennsylvania, Tennessee, Vermont, Virgin Islands
Note, added 08/26: A number of jurisdictions have entered into mutual reciprocity agreements for the portability of scores earned on the remote exam. These jurisdictions are: the District of Columbia, Connecticut, Illinois, Kentucky, Maryland, Massachusetts, New Hampshire, New Jersey, New York, Ohio, Oregon, Tennessee, and Vermont. The Texas Board of Examiners said on August 24 that they will accept a score of 270 or higher earned on the October remote bar exam offered by these jurisdictions.
Remote Exam Administration and Safety Issues: Remote bar exams are generally proctored by a combination of people watching webcam feeds and cheating detection software. I’ll get into the cheating detection software more later in this section. From a practical standpoint, you need a LOT more people to watch a lot of individual webcam feeds than you do to watch hundreds of people shoved into one room.
From a safety and privacy standpoint, a lot of people are very creeped out by remote test-proctoring. Although I don’t think any bar exam plans to do it as intensely as is described in this article from The Verge, the situation is similar enough to pose concerns. I’ve read reports of female test takers receiving Facebook friend requests from their male exam proctors after they’d literally watched them take an exam for several hours as well, which is….extremely creepy.
Remote Exams’ Effect on Less Privileged Test Takers: Even assuming the software was entirely reliable and trustworthy, not every test taker has the same access to reliable internet, computers, webcams, or a private, quiet space. Remember we’re in a global pandemic and recession, plenty of people just don’t have the financial ability to rent a hotel room, or buy a new computer or webcam. Many jurisdictions have put very strict rules in place which ban any person or pet entering the room during the exam, which causes issues for parents or pet owners who can’t afford or find a sitter during a pandemic, or for those who live in small spaces with roommates or family members.
Remote Exams’ Effect on Test Takers with Disabilities: Some test takers who qualify for accommodations for the bar exam have been told they can’t get those accommodations remotely and need to come in for an in person test. In addition, rules designed to prevent cheating have resulted in bans on leaving the room, even for a bathroom break, which can pose issues for pregnant test takers or those with disabilities. One test taker who’s 8 months pregnant said that her accommodations request for bathroom breaks was straight up denied, so flexibility doesn’t seem to be a rule here.
Remote Exam Security Technology Bias: Cheating detection software is the big reason why test takers are banned from leaving the room and why any person or pet is banned from entering the room during the exam; it could throw up a flag and cause problems for you later even if your cat walks in (presumably most people’s cats are not experts on adverse possession law).
In addition, remote proctoring uses facial recognition technology to ensure that the same test taker is logging on to the exam for each module. Studies have shown that current facial recognition technology is biased towards a white male dataset and often causes issues for female test takers, test takers of color, or anyone who doesn’t conform to a traditional “white male” look as recognized by a computer. This can lead to problems and delays for bar exam takers trying to log on to take their test after a lunch break. And when you’re taking such a high stakes, expensive test, every moment counts.
· TBD sometime in October - Florida (The planned test of ILG’s software on August 10 was postponed after numerous problems with it were identified after downloading it. UPDATE 08/26: The 08/19 exam was cancelled on 08/16. The Board will reschedule the exam for a date TBD in October; applicants may take the October exam or to postpone until February 2021. UPDATE 08/13: The Florida Board of Bar Examiners emailed applicants yesterday telling them not to download the software if they haven’t already done so. There have been numerous reports from Florida applicants over the past week that their banking/financial accounts were hacked shortly after downloading the software. ILG has apparently been dismissing these complaints as unconnected.)
6. Jurisdictions that gave a remote delayed bar exam (open book, non-proctored)
· August 4 - Indiana (one-day exam)
This entire approach was developed in response to the “repeated and unforeseen technical complicates” that resulted when Indiana tried to test its bar exam software from ILG in July.
· August 11-12 – Nevada [UPDATED 08/11, shortly after posting this blog, i just learned that Nevada also decided to offer their exam as an open book non-proctored exam. Nevada used the same vendor that Indiana used and Indiana’s test caused Nevada to push back its exam two weeks. Some test takers reported that there were still issues with the software used by Nevada during practice sessions.]
· August 24 or October 10 – [Louisiana UPDATED:08/13- Louisiana gave diploma privilege to recent law school graduates, but this left out ~300 people, such as those who already have a license in another state or those who are taking the Louisiana bar after previously failing it. Those who do have to take the Louisiana bar exam will now take an open-book test that they can submit via email, without live monitoring or proctors. The Louisiana Supreme Court stated that if it’s found that someone got help from another person during the exam though, that person will automatically fail and be banned from taking the exam for five years.]
7. Jurisdictions granting extensions of supervised/provisional practice or creating new supervised/provisional practice rules
· Alaska [updated 08/26], Arkansas, California, Colorado, Connecticut, Florida [updated 08/26], Georgia, Idaho [updated 08/26], Illinois, Kentucky, Massachusetts, Missouri, Montana, New Jersey, New York, Ohio, Pennsylvania, South Dakota, Tennessee, Vermont
Disclaimer: This is the approach I know LEAST about. Jurisdictions are taking very very different approaches toward this - in some places, it may just be an extension of supervised practice student license rules. Other jurisdictions may allow for more autonomy on the part of the temporarily licensed lawyer.
Financial Issues: Either way, this really isn’t a satisfactory approach. Those with temporary licenses are still going to have to take 1-2 months off work in the future to study for the bar exam, and given the state of the world, it’s hard to guess when that time will be. Employers are going to be really disinclined to hire someone knowing that they’re going to have to give them that time off in the future for them to remain licensed. In addition, employers will definitely use a provisional license as an excuse to pay those holding that license less.
8. Jurisdictions granting diploma privilege
· Diploma Privilege as an option, may take in person exam – Louisiana, Oregon (Updated 08/26: July in person exam, passing score reduced 8 points, October remote exam for local admission only), Washington
· Diploma Privilege alone – Utah
· Already had local Diploma Privilege - [UPDATED 08/13] Wisconsin already allows graduates of the two ABA accredited law schools in the state to seek admission to the state bar without having to sit for a bar exam and has done so since 1870. Graduates of out-of-state law schools must still take the bar exam to be admitted there (the state HAS denied a petition for diploma privilege from out of state students taking their bar).
I, obviously, support diploma privilege as the best option of all of these approaches. But even this option has numerous issues with it. Will employers accept licenses acquired through diploma privilege as valid or good enough? Will other states grant reciprocity? These concerns are real enough that Louisiana, Oregon, and Washington is still offering bar exams as an option to graduates who are concerned that diploma privilege won’t be enough.
Administratively - is it only accredited law school graduates that get diploma privilege? What happens to graduates of an unaccredited law school? Will those graduates alone be forced to take the bar exam?
Some people have voiced concerns that we’ll have unqualified lawyers if we grant diploma privilege. I personally think this is ridiculous, the bar exam tests memorization and short term recall far more than your actual ability to practice the law. Legal practice is almost always open book and you’re rarely going to be put in a situation where you need to spout off memorized facts and laws at a moment; even when that situation comes up, you’re likely to have ample time to prepare.
9. Jurisdictions that have denied petitions or requests for diploma privilege
· Alaska, Idaho, Illinois, Minnesota, Missouri, Nebraska, Nevada, North Carolina, Ohio, Pennsylvania, and Tennessee
10. 2020 Exam cancelled
· Delaware, Palau
Test takers in both of these jurisdictions will have to wait until July 2021 to take a bar exam and pursue licensure. This will obviously lead to lower pay and potential inability to get a job in the field you’ve trained for. Test takers will have to take 1-2 months off work next year to study for the exam, which will make employers pretty unhappy. Overall, it just leaves a lot of test takers in limbo.
ADDED 08/26: Bar exam software breakdown
I got my info from the brilliant Diploma Privilege for Connecticut’s spreadsheet, available over here as a Google sheet, so it’ll be updated a lot faster than this website if anything changes.
Examsoft on July 28: Michigan (800 test takers - crash which locked many users out for 10 - 37 minutes)
ExamSoft on October 5-6: Arizona, California (12,000 test takers), Connecticut (750), District of Columbia (1,100), Georgia, Idaho, Illinois (~2,200 based on previous commentary), Kentucky (350), Maryland (1,100), Massachusetts ( has announced a potential backup of an open book exam), New Hampshire (117), New Jersey (2,000), New York (8,000), Ohio (885), Oregon (300 person cap), Pennsylvania, Tennessee, Texas
ILG on August 11-12: Nevada (the exam was supposed to happen on July 29, but the test was pushed back by two weeks after defects emerged in an ILG beta test in Indiana. Nevada ultimately used ILG, but an earlier version of the software that eliminated features that have caused problems recently, most notably the verification and online streaming features. The exam was technically open book, but test takers on Twitter stated that given the short time for each essay, this didn’t really factor into how they took the exam. It does appear that Nevada’s bar exam occurred with relatively few issues.)
Software Failures and Issues so far:
Indiana planned to use ILG in July but abandoned the software completely after “repeated and unforeseen technical complicates” resulted when during a software test. Indiana ultimately conducted the bar exam open book via email.
[repeated from where I said it above in the post so feel free to skip this paragraph if you read that already] Michigan was the first jurisdiction to conduct a remote bar exam, on a day when no other jurisdictions were conducting it. The software crashed on the first day, which locked out some test takers for 10 - 37 minutes. Examsoft tried to blame this on a cyber attack, but many think this was an excuse and the software was simply just overwhelmed. The board of examiners said afterward that no data was compromised and test takers affected were given extra time, but that probably wasn’t very comforting to the many test takers who were anxiously freaking out at the time.
Florida planned to use ILG, but completely cancelled its August bar exam with three days to go after some pretty insane downloading issues resulted in numerous reports of test takers’ banking/financial accounts being hacked shortly after downloading the software. ILG has apparently been dismissing these complaints as unconnected.
/ahem/ let me repeat my numbers and rant from the top of the post.
CAN WE PLEASE DISCUSS THE FACT that Examsoft has not been used for a remote bar exam without major issue yet, even with just 1 jurisdiction/800 test takers (Michigan), and yet, 18 JURISDICTIONS plan to use it simultaneously to administer the test to OVER 30,000?! I just ran these test taker numbers (which are quite low, we're missing numbers from numerous jurisdictions offering remote examsoft bar exams) using a spreadsheet of info collected by the Diploma Privilege for Connecticut team and I'm frankly just...in jaw-dropping awe at this.
Let me run further math for you on that. 800 test takers on a remote bar exam in one jurisdiction (Michigan, that still had a significant issue when many users were locked out for 10-37 minutes on the first day of exams) is less than 3 PERCENT of the planned test takers who will be using examsoft to take remote bar exams on October 5-6. And again, those numbers are very low, as I don't have test taker numbers for Arizona, Idaho, Georgia, Massachusetts, Pennsylvania, Tennessee, or Texas (which alone historically has around 3,000 test takers!!).
THIS IS INSANE. THIS IS ABSOLUTELY RIDICULOUS. HOW CAN ANYONE THINK THIS IS REASONABLE OR GOING TO WORK.
When bar exam software has a significant issue the first time you use it in a remote setting, you don't go and then use it again for a remote use setting FOR OVER 37.5 TIMES THE PREVIOUS TEST TAKERS. This is BREATHTAKINGLY horrifying.
Obviously, despite writing over 3,000 words on this subject, this is just the tip of the iceberg. There’s a lot I haven’t talked about and a lot we don’t know. But please, if you’re convinced by my arguments here, join the fight for diploma privilege. United for Diploma Privilege has a pretty good run down of the organizers of the movements in each individual jurisdiction and a list of resources and upcoming events; I encourage you to reach out to the groups in your local area to help.
As you’ve seen now, this is a very complicated issue that jurisdictions are dealing with in a variety of different ways, and it’s all changing very quickly, so if anything is outdated or inaccurate, I apologize. You can always give me corrections via comment or via email at RachaelDickzen@gmail.com. Thank you!