I bet you thought I'd never get around to finishing this series...
Statistical Prospect Evaluation Primer: Part 4
The title of this post is a bit of a misnomer; there is no secret to prospect evaluation. You need the input of (multiple) scouts, your own observations, and finally statistical evaluation like I've presented in this series.
But there was one aspect of prospect evaluation I purposefully left out of the first three parts, probably because it seems wholly obvious.
Improvement
Each level of the minor leagues provides an ever increasing level of competition which acts as a giant filter for minor league clubs. For the most part, only those able to conquer A ball are allowed to advance to High-A, and those who conquer High-A allowed to advance to AA, and so on. This ensures only the cream of the crop even gets a shot at the major leagues.
Because each level provides an increased challenge, a prospect who maintains good production from year-to-year while advancing a level is often considered a good candidate for future major league success. But no prospect is perfect; they all have weaknesses, areas in which they can improve. And it's that improvement, that year-to-year improvement, that I love to find in a prospect.
I like to think of improvement, statistically observable tools progression, as the 6th tool. There is a large jump in competition between the majors and minor leagues, and a prospect who has demonstrated the ability to improve their game while in the minors (I believe) is more likely to be able to adjust to that jump in competition.
Put simply, I believe learning and adjustment is a skill. Some players have it, others don't.
After the jump, I take a look at the minor league careers of 4 current White Sox players to illustrate my point.
John Danks
John Danks minor league career provides a great illustration why you should ignore W-L record and ERA. He posted minor league career ERA of 4.20 with a dismal 21-30 record. If he can't even win minor league games or hold a bunch of wannabes to under 4 runs a game, how can possibly project him to have future major league success?
First, and maybe most importantly, he was exceptionally young for his league at every step. He also posted very good strikeout rates (9.3 K/9) and a K/BB ratio approaching our magic 3:1 at 2.80. But it's when you look more closely at Dank year-to-year and level-to-level progression that his improvement becomes apparent.
Danks received mid-season promotions every year in the minors, and almost always struggled with his control in his initial tour of a new level, only to show great improvement in a return trip to that level the following year. So while Danks didn't quite meet my magic 3:1 K/BB ratio for his minor league career, he always posted marks well above 3:1 on his return trip to a level.
Danks demonstrated the ability to learn, to adapt at the minor league level all while being young for his league. Combined with the excellent scouting reports, Danks was exactly the type of pitcher you'd expect to be able to make the adjustments to make a successful jump to the majors, as we've seen first hand with his addition of the cutter.
Paul Konerko
I almost feel guilty using Paul Konerko as an example in a piece like this. His pedigree as a top 10 pick and minor league career is that of a can't miss prospect, which is how he ended up ranked as the #2 prospect in all of baseball prior to the '98 season. But now that the White Sox have a number of legit prospects, this is the type of minor league career we're looking for.
Konerko began his minor league career as an 18 year old in short season ball, displaying a little power. His strikeout rate (17%) was a little high, but he was extremely young for his league. With a jump to high-A, an aggressive jump for a high-school draft pick, Konerko held his K-rate steady, flashed some more power and earned a promotion to AA the next year.
AA is often referred to as a litmus test for prospects, and Konerko passed with flying colors. He lowered his K-rate to 15%, raised his walk-rate to 13%, and upped his power yet again. And with his final full-season AAA, Konerko advanced even further. His cut his K-rate to under 11% and raised his walk rate to reach the magical 1:1 ratio. Oh, and he had 69 extra-base hits, including 37 HRs, although he was playing in one of minor league baseball's best hitter's parks. Konerko had advanced to become a darling of both scouts and stat-heads alike.
Brian Anderson
Now that we've seen what a couple of high-first-round success stories look like, let's take a look another first rounder who hasn't quite fared as well. Brian Anderson was never my favorite prospect, but searching the archives here you'll probably find me ranking him ahead of Chris Young and Ryan Sweeney, both of whom I liked better (long-term) than Anderson. The reason being, Anderson appeared to do everything well, and while I never thought he would be an All-Star, I thought he would be an adequate major league regular. I was wrong. Let's see why.
In his first full season, Anderson was assigned to high-A, which is the safe choice for your first-round collegiate picks. Anderson performed exactly how you'd expect from a blue chip prospect, posting solid walk (>10%) and strikeout rates (~15%), and earned a mid-season promotion to Birmingham. While Anderson's average and ISO took a bit of a hit after the promotion, his strike zone control remained good, or at least consistently adequate.
A year later at AAA, Anderson's OPS rebounded above his AA levels, but there was a great big ole warning sign in the form of a drastically increased strikeout rate, now around 22%. I was fooled. I saw an .800+ OPS from a plus-defensive CF, and figured he could easily replace the .736 Aaron Rowand provided in '05. And if he couldn't, I figured Young, who I liked better, but was not without flaws, would be ready to take his place for '07.
What I missed, or rather what Anderson never demonstrated over the course of his minor league career, was an ability to adjust to a jump in competition level, to learn from his failure. The Brian Anderson who broke camp with the '09 White Sox remains very much the same one the White Sox drafted in '03. I've never trusted a prospect who didn't show me some improvement since.
Chris Getz
Finally, we get to the long awaited reasoning behind my confidence in Chris Getz. He received an aggressive assignment to A-ball as a 4th round draft-pick, where Getz quickly proved he had an advanced approach at the plate posting a 10/35 K/BB ratio.The Sox took notice and skipped him over high-A (where you often see college first rounders sent) to AA in his first full-season.
Getz would struggle to hit the ball with any authority in Birmingham's expansive outfield, but still demonstrated excellent strike zone control with more walks than strikeouts. He returned to Birmingham the next season, and immediately showed better results at the plate while maintaining his positive plate approach. He would have been a candidate for a mid-season promotion, but injury would delay his AAA debut for another year.
Last season in AAA, Getz saw his K/BB numbers continue to trend in the wrong direction. But at 53/41 in 457 plate appearances, his K-rate remains well under the 15% danger zone and his BB-rate is close to 10%, .
The move to Charlotte's smaller ballpark also helped in the ISO category, as Getz saw a large spike in the HR and XBH categories. Though it's unclear how much of that spike can be attributed to a hitter-friendly ballpark.
Getz is far from a sure thing as a prospect, and his K and BB rates have actually trended in the wrong direction as he climbed the minor league ladder. But his rebound performance in AA, increased ISO in AAA, and K/BB ratio near 1:1 led me to believe he was the White Sox' best 2B candidate in February. And while he doesn't figure to be a star, his advanced approach at the plate and propensity to do of the little things leaves him in a good position to provide quaility at-bats for the Sox in the short term with a fall back of grindy utility player in the long-term.
There is still one last piece in this series which will highlight what we should be watching for in the box scores of current White Sox prospects. Both Jim and Larry have briefly covered this, but I'd like to have a more comprehensive list/post. Hopefully it will find its way to the blog in the next month, probably on an off-day like today.