Showing posts with label statistics. Show all posts
Showing posts with label statistics. Show all posts

Thursday, June 16, 2011

Bob Morse, Champion for Change

The most passive journalist on the planet is at it again today, where he discusses the latest ABA jobs data changes.
U.S. News had been among those urging the ABA to take action to improve the credibility of the important consumer information.

Yes, "urging." See, kids, this is how reform works. Figureheads like Bob Morse are a position to change the system immediately, and yet they do nothing. Then, when the people who actually care about reform show up and make a self-evident point, the coat-riders like Morse join the chorus. Then, when they write the history, they were a full-fledged member of the justified opposition, even though they refused to enact any reform steps for years.

But that's not all the magic from Bob's hand.

If the new ABA rules are implemented, U.S. News will use our own law school statistical surveys in fall 2011 to collect and eventually publish the entire new richer and more detailed set of employment and jobs data from each law school for 2010 J.D. graduates. When we gather this richer data set, we will be able to make a more exact determination of how our ranking methodology will change.

Think about this for a moment. The new ABA guidelines already make clear what information will be collected. Granted, Morse and Co. don't know what the response rates will be or how reliable the state-wide surveys will be, but you'd think they could be working with the methodology prior to getting the data itself. After all, statistical methodology should be theoretically-sound independent of the data.

Is Morse being ambiguous and as commitment-free as possible so he can make methadological adjustments to keep the T-14 the T-14, or the T-6 the T-6? I'll leave you to speculate, but it's hard for a cynic like me to not make that assumption given the nature of the propaganda business.

Monday, June 13, 2011

Viva Reform! ABA Adpots Some Changes to Reporting, Industry Shill Objects

The ABA Council on Legal Education and Admissions to the Bar has adopted more enhanced reporting standards. Law school transparency has a good write-up of the changes, and I encourage readers to just go there, but the basics, and my minor criticisms, are as follows:

1. Job placement: Will be divided into (1) employed in position w/ JD; (2) employed w/ JD preferred; (3) another professional job; (4) non-professional job; (5) student; (6) unemployed, seeking; (7) unemployed, not seeking; (8) unknown.

I really dislike keeping the "unknown" category, and believe those students should be presumed unemployed, seeking. I also dislike the "professional/non-professional" dichotomy and feel a generic "non-law" category with salary data would suffice. My fear is that schools are going to count legal and administrative assistants and anything "sales" as "professional" jobs.

A very welcome change is that schools will now apparently be required to disclose if they are funding any of the positions. The type of job (firm size, government, etc.) information looks the same, but they've added an "employment location" section, so prospective law students can know where they'll likely wind up, how they have no prayer at practicing internationally, etc.

2. Salaries: As far as I can tell, this is the biggest change. Salaries are now going to be divorced from the institution. They seem to be doing away with school-specific salary information, citing the unreliability of the surveys, the lack of available data, the granularity of the data, etc. Instead, they're going to look at it by state.

I think this is still subject to being confusing (e.g. Syracuse and SUNY-Bufallo are going to be advantaged by higher New York City salaries, right?), but it's a step in the right direction, because it at least seeks to address the "skewing" that takes place that allows schools to report median private practice salaries in the six figures.

LST has a summary of the other minor concerns. Also on their entry is a comment by Linda A. Spagnola-Wendling, assistant dean at N.C. Central, who whines for far too many paragraphs about the "statistics beast."

Law School Career Services Offices (CSO’s) cannot mandate, coerce, bribe, or otherwise direct their new graduates to answer the annual questionnaire. It is a completely voluntary exercise which only goodwill and nagging manages to elicit responses.
....
Compounding this stress now is US News & World Report’s new method of calculating the overall employment rate used in their ranking system. Instead of using the number of graduates whose status is known as the denominator, they are using the number of total graduates. What this does in practical, mathematical terms is calculate all unknown graduates as unemployed. Regardless of the reason that the graduates failed to respond, to presume that they are unemployed is inaccurate, misleading and extremely detrimental to all the constituencies that rely on this information.
...
Calculating the employment rate based upon the known statuses of graduates who have responded supplies us with a representative sample – a well-known and widely accepted statistical practice. To deviate from this simply counters good reporting practices.
...
The statistical beast does not serve any master, either; merely its own greediness. Prospective law students will not get any more accurate information from this process, in fact it may be worse than before. The new ranking system races full steam ahead without notice to the law schools and without a plan of guidance or tools to help them reach the same point.

I've read a lot of dumb comments in my time blogging on this field, but this woman might take the cake in terms of unabashed, lazy inanity, and it appears that her poorly-written whine-fest was copied-and-pasted from elsewhere to boot.

First, she is statistically retarded. Voluntary "opt-in" responses from a diverse population never provide a valid sample when the variable affects the likelihood of response! To even use the term "representative sample" when the survey participants have the option to respond or not borders on statistical blasphemy. This is taught during the first week of any self-respecting college statistics course. But apparently this nimrod didn't learn basic statistics on her way through Rutgers (Bachelors) and Seton Hall (J.D.).

As I've explained previously, there was no basis for the previous U&S News assumption that 25% of the unknown graduates were employed. What that baseless assumption did was promote the unscrupulous to ignore graduates that they might have otherwise known to be unemployed, or to be more aggressive in contacting those who graduated at the top of the class.

No one is "presuming" that anyone is unemployed. But what I and the new U.S. News ranking will not do is presume someone is employed without proof. That's what the old system did. That's why it's changed, and why career service shills are the only people who favored it.

Second, Linda, no one is asking you and your crappy little office to be perfect and collect a response from every single graduate. But what I expect, and prospective law students need, is an accurate portrayal of that data. Notice in the standards that no one is really asking your office to work harder; I'm sure you work hard already. The crux of the changes is on the presentation side.

Her stringent efforts to oppose it with distortions of basic statistics and clumsy, heavy-handed metaphors suggest that she prefers the old, demonstrably-flawed system to the changes being made, which are being unanimously met with approval from groups like LST (although they say they don't always go far enough; I obviously concur). Gee, I wonder why that is?

Is this not a blatant admission that the old system distorted reality in favor of the law schools and the people who benefit from them? Is this not a strong sign that the changes are closing some oft-used loopholes to make the sky appear more blue?

Third, did y'all notice her use of words? "The statistical beast does not serve any master, either; merely its own greediness." This brazen piece of human waste is a law school administrator accusing industry reform advocates of greed, truly a ballsy approach. Linda Spagnola-Wending makes $75,000 a year working a relatively cushy administrative job (stable work week, light summers, etc.) in a low-rate state school whose tuition has increased 90+% for in-state residents since 2005 (hint: that's far more than the flagship university...), all in a state that has seven law schools and no major metro areas (unless you count Charlotte or Raleigh, which you shouldn't).

And yet we - those who want to better illuminate the collected data so that the numbers reflect reality instead a marketing narrative - are the greedy ones. I would have thought her Seton Hall legal education would have given her a better term, but I suppose not. In any event, this is truly Orwellian: those who want to enhance consumer protection and prevent consumer regret are greedy.

The real tell that this woman is an insufferable education-sector bureaucrat comes in the last paragraph of what I've quoted: "The new ranking system races full steam ahead without notice to the law schools ...."

Because, you see, to a career services person, the endgame isn't actually employing students or even getting accurate data, it's gaming the rankings. Don't take my word for it. Take hers. Why else do you think she feels the law schools need "notice" of how a 3rd-party "journalism" outlet ranks their institutions? Why should they be entitled to notice, and what self-respecting journalist outlet would actually give it to them? And if all the law schools are on an even playing field with respect to presentation, is it really a problem? And why, regardless of what the journalist outlet decides to do with the data, does that have anything to do with how the ABA collects data, which, one would assume, would have more to do with accreditation concerns?

In this ridiculous and ill-conceived letter, Spagnola-Wending wants us to believe that transparency is important, but not worth the extra effort for her office; that data collection issues are the same as data presentation issues; that the ABA somehow has authority over third-party ranking systems that should give schools notice so they can be more quickly manipulated; that we can assume many students not responding may "be indeed employed but merely too busy working in fulfilling and demanding legal jobs to respond" (yes, she actually wrote that); and that the ABA/state bars need to put another mandatory hammer on recent law graduates, as if non-dischargable debt isn't enough ('cause, you know, everything should be blamed on students and graduates; note how in this industry the previous customers are the bad guy...think about it).

Again, no one is asking career services offices to track down every last graduate. But if they do present the information, it needs to be an accurate portrayal of the class rather than a misleading presentation where half the class is in private practice making six figures when, in reality, 50+% are working jobs no one would ever go to law school to take. That's what these reforms get at, and that's why I think they're a positive step.

In fact, almost anything is a positive step when the previous methods of data collection have led to complete retards like Arthur Snyder ignoring the brutal job market while he builds a useless law school. The time for the ABA to stop being complicit in the misrepresentation of the legal reality has long passed. It's nice to finally see an attempt to correct some of the loopholes.

Wednesday, June 8, 2011

MBA USNEWS Flawed Numbers, Kansas Applications Down Big, and Duke Finds New Way to Grab Tuition Money

1. Grad School U.S. News Fraud:

From BusinessWeek:

The Gainesville Sun last night reported that the University of Florida Warrington College of Business supplied the magazine with inaccurate job-placement data, resulting in a higher ranking.

An anonymous complaint made through the university’s ethics hotline in August alleged that 37 percent of UF’s 2009 MBA graduating class had jobs at graduation, while 53 percent had jobs three months later. The figures supplied to USNWR indicated 53 percent placement at graduation and 79 percent three months later. UF was ranked 39th in 2009, falling two spots from the year before; in 2010 it fell to 47th.
An investigation found no evidence of willfulness, but you can't help but wonder at the similarities. Does any school ever drop as a result of submitting false numbers? Gee, I wonder why that never happens. In any event, the article gives us another look into the askew, dullard mind of Bob Morse, the laziest journalist/statistician on planet Earth:
[Morse] said he thought data accuracy was not a widespread problem, but it's one that should be addressed by organizations such as the American Bar Association and the MBA-CSC in their capacity as standard-setting bodies, not by the media outlets that conduct rankings.
"It's not my problem" is just about the shittiest possible answer a bona fide journalist or statistician can come up with. People who are actually interested in finding the truth - rather than serving as a press agent for the official organizations that supply them - actually get off their asses and find the truth, ensure accurate data, stop official manipulation where it's suspected, etc. I think at this point any illusion of U.S. News being anything more than a puppet with no journalistic or mathematical intentions is shattered by Morse's own admissions.

2. Kansas Applications Down

From the K.C. Star:

The University of Kansas Law School says its applications declined 23 percent for this year compared with last year.
...
About 850 students applied to the law school this year, down from about 1,100 last year.
They're still far from being underwater (they only admit about 350-400 each year), but this is a state flagship university. If you want to ultimately practice is Kansas or the Kansas City metro area, you can't find a better school to attend. I wonder how the quality of their applicant pool is, and I wonder what this kind of drop signifies for places like Washburn and UMKC that are 2nd-choices for KU applicants. I imagine we start seeing sub-150 LSATs more prevalently and schools have to reach further than they normally would.

3. Duke Innovates in Ways to Leach

From the Nat'l Law Journal:

The school announced this week that it will launch a master of laws program in judicial studies geared specifically to judges....

The LL.M. program will open during the summer of 2012 to 10 to 15 sitting judges. They will take intensive four- to six-week sessions over the course of two summers. The curriculum will include classes and seminars in which both judges and scholars look at the history of the judiciary and judicial decision-making. Participants will examine topics including judicial independence, bias, the selection process and use of specialized courts.
Tuition for this four- to six-week program? $17k. For roughly 1/6 of the normal school year, with a guaranteed small class size and what surely will be the lightest teaching, lowest resource demand in academic history, the school is charging over 40% of its full-year tuition price.

Ca-ching! I'm sure Duke justifies this by some inflated beliefs that the judiciary could use the advanced training, but let's be real: most courts are overworked and, frankly, the judges have better things to do than take classes at Duke for $17k and a worthless L.L.M. If a judge in my district went to this thing and was subject to election, I'd vote against him/her on principle.

But hey, you have to hand it to Duke. If kids are going to start turning down law school to find better uses of their money and time, the law schools are naturally going to move to pushing education for existing practitioners, more than they have already.

Tuesday, April 26, 2011

Prof. Paul Campos Does Some Independent Research for The New Republic

Although this article in The New Republic by Paul Campos, Professor of Law at Colorado, seems to be phrased more as a general myth-busting piece about how law schools push misleading statistics and the results thereof, the most interesting part of the article is when Prof. Campos reveals he did some revealing in-depth study of one school's employment numbers:
In order to calculate [the number of graduates employed in full-time positions], I used employment data drawn from 183 individual NALP forms, in which graduates of one top 50 school self-reported their employment status nine months after graduation. This data suggests that fully one-third of those graduates who report they are working in full-time jobs that require a law degree are in temporary, rather than permanent, positions....

When we take temporary employment into account, it appears that approximately 45 percent of 2010 graduates of this particular top-50 law school had real legal jobs nine months after graduation....
In what may have been a separate research task, Prof. Campos claims to have audited a sample of NALP responses:
[I] found several instances of people describing themselves as employed permanently or full-time, when in fact they had temporary or part-time jobs (I found no instances of inaccuracies running in the other direction). Perhaps some graduates exaggerate their employment status out of embarrassment, or for strategic reasons, but, whatever their reasons might be, this apparently not uncommon practice suggests that the true employment rate should be lowered even further.
Completely unsurprising but still revolting. This article speaks for itself, but I want to make four brief observations:
  1. The New Republic is hardly a sworn enemy of higher education; if anything, I would guess a significant portion of their readership exists because liberal arts majors, graduate students, and professors persist.
  2. The University of Colorado-Boulder was ranked 47th in the most recent US News and World Reports. Should we assume it's the "top 50 school" he's referring to?
  3. Granted, Paul Campos is generally a skeptic of American law, but one reason I think professors like Paul Campos come forward and actually show concern about this colossal mess is that - lost in the system among the tweed jacket privateers - there are actually people who care about their students and build relationships with many of them. As these types of professors see great students and good, hard-working people utterly fail on the job market, they can't help but research what the hell is going on and how this mess happened. I would expect more professorial inquiry as it becomes clear that many high-quality students from the classes of 2008, 2009, 2010, and now 2011 will get absolutely swallowed by an unjust system.
  4. If this were published just one year ago, it would have been ground-breaking journalism that would have seemed out of left-field and startled some of those who used to staunchly write-off the so-called scamblogs as bitter extremists shouting in the woods. Now it's fairly routine and accepted fare. Think about that for a second.

Tuesday, March 29, 2011

How Not to Do a Value Survey

This U.S.N.W.R. article seeks to find which schools are the best values by looking at the median salary to average debt ratio. Right away we have a methodology problem by comparing an average to a median. Another problem is that the survey includes only private sector salaries, ignoring the sizable amount of government workers who have salary/debt ratios well below one.

The worst problem, of course, is that they're using the schools' horribly flawed, self-reported numbers.

Here's the list for giggles:

1. Southern U.
2. Georgia State
3. Rutgers-Camden
4. Texas Southern
5. Brigham Young
6. North Carolina
7. Texas
8. Loyola-New Orleans
9. Georgia
10. California-Berkeley

There's like four or five of these that make sense. Anyone who thinks Southern U. Law Center grads are making five times their debt load after graduation is a fool, and if anyone can prove to me that Loyola-New Orleans median grads are actually making 84k a year with only 45k in debt (total cost full time is 45k a year and less than 20% get juicy scholarships on the tuition part), I'll eat my computer piece by piece and then move to Louisiana.

Garbage in, garbage out. If anyone actually did this survey honestly, perhaps only 15-20 schools would have salary/debt ratios over 1.0.