Exploring the Impacts of Salary Allocation on Team Performance

Similar documents
The Impact of Star Power and Team Quality on NBA Attendance THESIS

Effect of homegrown players on professional sports teams

NHL SALARY DETERMINATION AND DISTRIBUTION A THESIS. Presented to. The Colorado College. Bachelor of Arts. Ian Young. February 2015

Investigation of Winning Factors of Miami Heat in NBA Playoff Season

International Discrimination in NBA

The relationship between payroll and performance disparity in major league baseball: an alternative measure. Abstract

Gain the Advantage. Build a Winning Team. Sports

Pierce 0. Measuring How NBA Players Were Paid in the Season Based on Previous Season Play

Effects of TV Contracts on NBA Salaries

THERE S NO I IN TEAM

NBA TEAM SYNERGY RESEARCH REPORT 1

A Simple Visualization Tool for NBA Statistics

The Effect Alternate Player Efficiency Rating Has on NBA Franchises Regarding Winning and Individual Value to an Organization

save percentages? (Name) (University)

University of Nevada, Reno. The Effects of Changes in Major League Baseball Playoff Format: End of Season Attendance

Running head: DATA ANALYSIS AND INTERPRETATION 1

Regression to the Mean at The Masters Golf Tournament A comparative analysis of regression to the mean on the PGA tour and at the Masters Tournament

PLAYING GENERAL MANAGER: A SPORT FINANCE EXPERIENCE. Mike Mudrick Sport Management June 7, 2016

Efficiency Wages in Major League Baseball Starting. Pitchers Greg Madonia

Are the 2016 Golden State Warriors the Greatest NBA Team of all Time?

SPATIAL STATISTICS A SPATIAL ANALYSIS AND COMPARISON OF NBA PLAYERS. Introduction

Department of Economics Working Paper

AN ABSTRACT OF THE THESIS OF

NFL1. Do you think television shows, in general, are getting better or getting worse?

Our Shining Moment: Hierarchical Clustering to Determine NCAA Tournament Seeding

Analysis of Labor Market Inefficiencies in the NBA Draft Due to College Conference Bias

Team Number 25 Case: Cody Franson Club s Representative

Evaluating and Classifying NBA Free Agents

Predicting the Draft and Career Success of Tight Ends in the National Football League

Opleiding Informatica

Math SL Internal Assessment What is the relationship between free throw shooting percentage and 3 point shooting percentages?

PLAYER SALES, TRADE OF PLAYERS

An Analysis of the Effects of Long-Term Contracts on Performance in Major League Baseball

The Economics of Sports. Chapter 5. Competitive Balance MICHAEL A. LEEDS PETER VON ALLMEN FIFTH EDITION

Effects of Incentives: Evidence from Major League Baseball. Guy Stevens April 27, 2013

Superstars Of The Oklahoma City Thunder (Pro Sports Superstars NBA) By Max Hammer READ ONLINE

PREDICTING the outcomes of sporting events

Salary in the National Basketball Association

Show Me the Money: An Analysis of the Impact of Free Agency on NFL Player Performance. Ben Singer, 2009

How to Win in the NBA Playoffs: A Statistical Analysis

2013 Hockey Arbitration Competition of Canada

2013 HOCKEY ARBITRATION COMPETITION OF CANADA. Chris Stewart v St. Louis Blues (NHL) SUBMISSION ON BEHALF OF CHRIS STEWART TEAM #14

STATE OF NEW YORK OFFICE OF THE STATE COMPTROLLER 110 STATE STREET ALBANY, NEW YORK September 2015

!!!!!!!!!!!!! One Score All or All Score One? Points Scored Inequality and NBA Team Performance Patryk Perkowski Fall 2013 Professor Ryan Edwards!

Compression Study: City, State. City Convention & Visitors Bureau. Prepared for

Home Team Advantage in the NBA: The Effect of Fan Attendance on Performance

Team 1. Lars Eller vs. Montreal Canadiens. Submissions on behalf of Montreal Canadiens (Team Side)

The Professional Sports Wives Magazine

This page intentionally left blank

Scoring dynamics across professional team sports: tempo, balance and predictability

Basic Wage for Soccer Players in Japan :

Fantasy Basketball. Project Guidelines:

Season Ticket Basketball 2003

Income Inequality in American Professional Sports Leagues

Department of Economics Working Paper

Economics of Professional Sport

ANALYSIS AND COMPARISON OF COMPETITIVE BALANCE IN THE SPANISH ACB BASKETBALL LEAGUE: A PRELIMINARY STUDY

The Rise in Infield Hits

Men in Black: The impact of new contracts on football referees performances

Clutch Hitters Revisited Pete Palmer and Dick Cramer National SABR Convention June 30, 2008

Scoresheet Sports PO Box 1097, Grass Valley, CA (530) phone (530) fax

Automatic Identification and Analysis of Basketball Plays: NBA On-Ball Screens

Columbia University. Department of Economics Discussion Paper Series. Auctioning the NFL Overtime Possession. Yeon-Koo Che Terry Hendershott

Basketball field goal percentage prediction model research and application based on BP neural network

HOCKEY ARBITRATION COMPETITION OF CANADA

STATE OF NEW YORK OFFICE OF THE STATE COMPTROLLER 110 STATE STREET ALBANY, NEW YORK September 2015

Using Spatio-Temporal Data To Create A Shot Probability Model

Player Performance and Team Revenues: NBA Player Salary Analysis

! How the West was Lost: Investigating Scheduling Bias in the NFL

Analytics Improving Professional Sports Today

2016 Scoresheet Hockey Drafting Packet (for web draft leagues) Player Lists Explanation

Predicting the Total Number of Points Scored in NFL Games

The Worth of NFL Free Agent Quarterbacks. by Kenneth Goit

JEFF SAMARDZIJA CHICAGO CUBS BRIEF FOR THE CHICAGO CUBS TEAM 4

Drafting their Way to Success? Draft Rank and Team Success in the National Hockey League.

A Competitive Edge? The Impact of State Income Taxes on the Acquisition of Free Agents by Major League Baseball Franchises

THE GLASS CEILING OF SPORTS

An Empirical Analysis of the Contract Year Phenomenon in the National Football League

IN THE MATTER OF SALARY ARBITRATION BETWEEN: LARS ELLER - AND - THE MONTREAL CANADIENS BRIEF IN SUPPORT OF THE MONTREAL CANADIANS HOCKEY CLUB (TEAM 8)

Mats Zuccarello-Aasen v. New York Rangers. Team 4. Representing: the Player

Honest Mirror: Quantitative Assessment of Player Performances in an ODI Cricket Match

Last Revised 5/27/2018

IN THE MATTER OF A SALARY ARBITRATION LARS ELLER -AND- MONTREAL CANADIENS NATIONAL ACADEMY OF ARBITRATORS

2017 GIRLS IN HOUSE BASKETBALL BAA/BAC and other assoc. in our league RULES

1. Answer this student s question: Is a random sample of 5% of the students at my school large enough, or should I use 10%?

Kelsey Schroeder and Roberto Argüello June 3, 2016 MCS 100 Final Project Paper Predicting the Winner of The Masters Abstract This paper presents a

BASKETBALL PREDICTION ANALYSIS OF MARCH MADNESS GAMES CHRIS TSENG YIBO WANG

Caesars palace odds sportsbook

A Comparison of Team Values in Professional Team Sports ( )

Two Machine Learning Approaches to Understand the NBA Data

PREDICTING THE FUTURE OF FREE AGENT RECEIVERS AND TIGHT ENDS IN THE NFL

Transfer Composition of Division I Teams July 2018

Using Actual Betting Percentages to Analyze Sportsbook Behavior: The Canadian and Arena Football Leagues

Analyzing NBA Champions and the Player Efficiency Rating

He Got Game Theory: A Melodrama

IN THE MATTER OF SALARY ARBITRATION BETWEEN: LARS ELLER -AND- THE MONTREAL CANADIENS SUBMISSION ON BEHALF OF LARS ELLER TEAM 21

TECHNICAL NOTE THROUGH KERBSIDE LANE UTILISATION AT SIGNALISED INTERSECTIONS

N.F.L. Collective Bargaining Agreement and an Uncapped Year Questions that Professional Football Fans Need Answers To. Outline for Sports Panel

Evaluating The Best. Exploring the Relationship between Tom Brady s True and Observed Talent

Commodity Endowment Funds

Transcription:

University of Pennsylvania ScholarlyCommons Summer Program for Undergraduate Research (SPUR) Wharton Undergraduate Research 8-24-2017 Exploring the Impacts of Salary Allocation on Team Performance Jimmy Gao University of Pennsylvania Follow this and additional works at: https://repository.upenn.edu/spur Part of the Applied Statistics Commons, Business Analytics Commons, Sports Management Commons, Sports Studies Commons, and the Statistical Models Commons Recommended Citation Gao, J. (2017). "Exploring the Impacts of Salary Allocation on Team Performance," Summer Program for Undergraduate Research (SPUR). Available at https://repository.upenn.edu/spur/23 This paper is posted at ScholarlyCommons. https://repository.upenn.edu/spur/23 For more information, please contact repository@pobox.upenn.edu.

Exploring the Impacts of Salary Allocation on Team Performance Abstract Study of salary has been an increasingly important area in professional sports literature. In particular, salary allocation seems to be a crucial factor of team performance in NBA, given credit to the wisdom of team managers. This paper seeks to extend the scope of existing research on basketball by investigating on how salary allocation affected team performance and exploring other factors that lead to team success. Our findings indicate a moderate correlation between salary allocation and team performance, and average Player Efficiency Rating is more crucial factor of team performance in comparison. Keywords Basketball, Salary Allocation, Player Efficiency Rating (PER), Superstar Effect, Golden State Warriors Disciplines Applied Statistics Business Analytics Sports Management Sports Studies Statistical Models This working paper is available at ScholarlyCommons: https://repository.upenn.edu/spur/23

Exploring the Impact of Salary Allocation on NBA Team Performance Acknowledgement I would like to thank Dr. Schurmans for accepting me into the SPUR program and encouraging me to do research. I d like to thank Professor Veeraraghavan for serving as my research advisor and providing guidance throughout my research experience. Abstract Study of salary has been an increasingly important area in professional sports literature. In particular, salary allocation seems to be a crucial factor of team performance in NBA, given credit to the wisdom of team managers. This paper seeks to extend the scope of existing research on basketball by investigating on how salary allocation affected team performance and exploring other factors that lead to team success. Our findings indicate a moderate correlation between salary allocation and team performance, and average Player Efficiency Rating is more crucial factor of team performance in comparison. Keywords salary allocation, Player Efficiency Rating (PER), Superstar Effect, Golden State Warriors Disciplines Sports Basketball Salary and Team Performance Analysis

1. Introduction There has been an increasing research interest in studying the relations between salary allocation and team success in professional sports over the years. A number of researchers have investigated on whether the amount of salary impacted the team success, measured by different metrics ranging from team revenue to winning percentage. Research has indicated a positive correlation between the team payroll and team success. These research studies encompass multiple sports such as basketball, football, baseball and ice hockey, with a focus on the four major professional leagues in the United States and Canada. In the past several years, the salary cap in National Basketball Association (NBA) has been increasing drastically, with a further projected increase after the league signed a gigantic nine-year, $24-billion TV-deal this year. 1 Evident from the changes from the 2015-2016 season to the 2016-2017 season, the salary cap rose by a whopping $24 million from $70 million to $94 million while the luxury tax limit also increased by an even larger amount at $28 million from $85 million to $113 million. 2 This trend, known as The Superstar Effect, creates further opportunities for teams to sign multiple superstars to compete for championships: the best example is the former Oklahoma City Thunder superstar small forward Kevin Durant, who was able to sign with the Golden State Warriors in the 2016 off-season because of the increase in the salary cap and Warriors superstar Stephen Curry s cut-rate four-year, $44-million contract. 3 Later, with four NBA All-Stars in their starting lineup, the 2017 Warriors were considered as the most talented team in the NBA history and was described as a juggernaut by Forbes Magazine contributor Vincent Crank, 4 crowning the Larry O Brien trophy after finishing the playoffs with a historic 16-1 run in 2017. 1 Prada, 2014 2 Zillgitt, 2017 3 Badenhausen, 2017 4 Frank, 2017

Seeing the significance of salary in professional basketball leagues on team success, this paper will explore with a statistical approach to investigate the relationship between the allocation of salary in an NBA team and the success of a team, measured mainly by the winning percentage in the regular season. While advancing to the playoffs and accomplishing a championship are also good indicators of team performance, we choose the team winning percentage during the regular season because team performance is more consistent during this time span compared with post-season playoffs where winning is highly affected by external factors such as home court advantage. According to recent basketball research conducted by Larry Coon in 2017, the correlation between team payroll and regular season wins is now very strong. For the 2010-11 NBA season, the correlation coefficient 1 between team payroll and regular season wins was 0.53 5 -- high enough to conclude that teams with deep roster have been able, to some extent, have been able to achieve successful simply by spending more money on talent. Although the recent correlation coefficient during the 2016~2017 season declined to 0.35 3, this statistical result still demonstrated a moderate correlation between the two. This paper takes one step further to investigate on the impacts of the salary on NBA teams, specifically on how the allocation of the salary affected the performance of these teams during the regular season across different years. Furthermore, this paper goes beyond salary distribution to investigate on other key factors that affect team success on the basketball. Section 2 of the paper explores how data is cleaned and organized. Section 3 synthesizes the analysis of Section 2 and constructs a model on the team performance by using the winning percentage of the team during the regular season as a key metric. 5 Coon, 2017

2. Data and Methodology In this section, we discuss how the data about the team performance and salary of players is scraped from the Internet and cleaned. We then process data to explore the correlations between the salary distribution and team performance. Through several stages of analysis, we choose to investigate additional factors that affect the team performance along with salary distribution. 2.1 Data Scraping and Cleaning Since the winning percentage of NBA teams during the regular season is most direct measure of team performance, we extracted the data on the number of wins for all 30 NBA teams during 5 regular seasons from 2012 to 2017 due to a steady increase in salary cap from 2011 and omitted the 2011-2012 season because it was shortened to 66 games. Because all teams play 82 games during the regular season, the winning percentage can be calculated by the formula: Team Winning Percentage = No. of Wins in a Season 82 In order to measure the salary distribution of NBA teams, we have to first get the data about the salary of every single player for all 30 NBA teams from 2012 to 2017. We choose to use data from a website called Basketball Reference because it takes into account the movement of players during trades and signings of free agents in the middle of the season. After scraping the data with R, we have 150 columns of data representing the salary breakdown of 30 teams during the past 5 regular seasons. To measure the salary distribution in a team, we use three different metrics: standard deviation, Gini Coefficient and Robin Hood Coefficient. The standard deviation measures how much the salary of each player in the team deviates from the mean. Gini Coefficient and Robin Hood Coefficient, compared with standard deviation, are more general measurements of dispersion as they are invariant of scale or units, and are bounded by [0, 1]. While these two metrics are commonly used to measure the income inequality of countries at a macroeconomic level, they can also be used

in the measurement of wealth inequality 6 such as in this context of salary distribution. However, these two coefficients also possess certain limitations: the two coefficients will have a downward bias on the measurement of salary distribution because the data size for each team in a season is very small, ranging from 13 to 28 players. This leads to an underestimation of salary inequality in a team, thus affecting the correlation between salary distribution and team winning percentage. 2.2 Finding Correlation After calculating the Gini Coefficient and Robin Hood Coefficient of all 30 NBA teams across the past five seasons, we run a correlation test between team winning percentage and these three metrics of salary distribution including the standard deviation of salary with Python. Before doing so, we first standardized the salary distribution and team winning percentage data with the following formula: Standardized x = x E(x) σ Measure of Salary Distribution Correlation with Team Winning Percentage Standard Deviation 0.309 Gini Coefficient 0.035 Robin Hood Coefficient 0.100 Table 1: Correlation with Team Winning Percentage for Different Measures of Salary Distribution According to Table 1, we find the highest correlation with team winning percentage in the standard deviation of salary at 0.309, which is also demonstrated in Figure 1 below when running a regression on these variables. Though correlation coefficients at higher than 0.4 are usually required to indicate strong statistical significance between two variables, a coefficient of 0.309 at least demonstrates a moderate correlation between the standard deviation of salary and the team winning percentage. The intuition behind this might be that the more unequal salary allocation to players in 6 Gini, 1936

the same team means that there might be more stars in the team that can contribute tremendously more than average players with their high caliber. As a reward to their talent, they are given a significantly higher salary than their teammates with average skills. Due to the Superstar Effect, teams that are composed of players with different levels of talent tend to win more games compared with those equipped with players of same levels of talent. Figure 1. Least Squared Regression of Team Winning Percentage on Standard Deviation of Salary Simultaneously, we find from the table that there is not a significant correlation between the team winning percentage and the other two metrics, namely the Gini Coefficient and Robin Hood Coefficient of the salary data. This can be partially explained by the underestimation of the salary distribution under the calculation of these two metrics, given the small population in the data. Another reason could be that these two metrics are invariant to scale, while the standard deviation metric takes into account the values of the salary. Overall, the data indicates that the correlation between salary distribution and team performance is not very significant. This hints that the amount of salary given to players cannot directly reflect the player talent that determines his or her performance at games. Because the salary floor for a team is 84.73 million and the team payroll is required to go beyond this number, mediocre players have a

high chance of getting high salary at teams at bad locations that cannot attract star players during free agency like Indiana Pacers. Overpaying these players, though creating an incentive for these players to practice harder, cannot improve the quality of these players instantaneously and therefore does not affect the team winning percentage. After realizing that the effectiveness of uneven salary distribution is contingent upon player quality in a team, we decide to look into existing advanced metrics that may directly impact the team performance, namely the Player Efficiency Rating. 2.3 Exploring Player Efficiency Rating Player Efficiency Rating (PER) is an advanced metric that measures the quality of an NBA player holistically. The calculation of PER is based on a complicated formula that sums up positive performance metrics such as points, rebounds and assists and subtracts negative performance metrics such as turnovers and personal fouls with assigned coefficients. PER is a comprehensive measure of the value of a single player as it takes into account the all-around performance of players on the court. According to the PER data posted by Basketball Reference in 2016, former legend Michael Jordan and current superstar Lebron James are sitting at the top two spots on the all-time PER leaderboard, with a total rating of 27.91 and 27.65 7 respectively. Based on the Superstar Effect, it is then intuitive to reason that there is a strong positive correlation between the standard deviation of PER among players in a team and the team winning percentage. Thus, a similar correlation was run between the team winning percentage and the three afore-mentioned metrics of PER spread, namely the standard deviation, Gini Coefficient and Robin Hood Coefficient. In addition to measuring the dispersion of PER, an additional correlation was run on the average PER. 7 Basketball Reference

Measure of PER Correlation with Team Winning Percentage Standard Deviation 0.175 Gini Coefficient 0.146 Robin Hood Coefficient -0.009 Average 0.287 Table 2: Correlation with Team Winning Percentage for Different Measures of PER According to Table 2, we find that neither the Gini Coefficient nor the Robin Hood Coefficient of PER has a significant correlation with team winning percentage. However, since the correlation coefficient between the standard deviation of PER and team winning percentage is close to 0.2, there is at least a weak correlation between the two, likely due to the superstar effect. The metric with the highest correlation coefficient 0.287 is average PER, which shows that the average player quality in a team is in some ways more important than a widespread player quality in a team with superstars especially during an 82-game regular season. The bench players play a substantial amount of time during games and thus are crucial to the team performance. This observation means that a non-superstar team with a consistent player quality in both the starting lineup and the substituting lineup is more likely to win compared with a superstar team with a high standard deviation of PER where bench players have low ratings and perform significantly worse than their superstar teammates. 3. Model After cleaning the data and running correlation tests between the team winning percentage and different metrics of salary and PER, we come up with a model of that best measures the team performance, with the team winning percentage as a proxy. After weighing different metrics and balancing statistical significance in the model with correlation coefficient of the metric itself, we

choose to run a multiple regression of team winning percentage on the average PER and the Robin Hood Coefficient of salary on Python and find the following function: Team Winning Percentage = 0.034 + 0.029 Average PER + 0.233 Robin Hood Coeffcient of Salary Although the coefficient of the average PER in the model is very low at 0.029, the metric demonstrates the highest correlation with team winning percentage among all the metrics of PER. Meanwhile, even though it has a slightly lower correlation with team winning percentage than the Standard Deviation of Salary, the Robin Hood Coefficient of Salary is chosen as a factor in the model because it has a higher statistical significance due to high t-value than the standard deviation and thus fits in the model better. 4. Discussion on Model While the model intends to take into account different situations, there are some weaknesses that we need to take into consideration. First, unlike other professional leagues like NFL and NHL, NBA imposes a soft cap on the team salary, offering the opportunity for teams to go beyond the salary cap numerous exceptions through different exceptions without paying any luxury taxes. Famous exceptions include the Larry Bird Exception and Mid-Level Exception, where the salary of players signed with these exception contracts are not included the annual team payroll. For instance, the mid-level exception allows teams to sign one player at a specified maximum amount. 8 Second, the 24-million increase in salary cap from 70 to 94 million gives teams an edge to sign multiple quality players at reasonable salary levels without compromising by lowering the salary of other players. Thus, this policy reduces the impact of salary distribution on team performance and makes the Robin Hood Coefficient of Salary less significant in the model. This can be shown by the 8 Coon, 2017

decrease in the correlation coefficient between team payroll and regular season wins from 0.53 to 0.35 from the 2010~2011 season to 2016~2017 season. 3 Third, teams have different goals. Some teams that aim at contending for playoff spots or even championships are willing to afford luxury taxes. This might lead to the reduction of the Robin Hood Coefficient of Salary while maintaining at a competitive winning percentage of the same team. Ultimately, the correlation between these two variables would be lower and affects the selection of the Robin Hood Coefficient of Salary in the model. At the same time, other teams that aim at tanking the team to gain high draft picks might intentionally lose games, which artificially reduces the average PER of the team and can bring down the correlation between team winning percentage and average PER. Last but not least, the model does not take into account the complexity of contracts such as signing star players to a maximum level. For instance, the salary under the maximum contract is contingent upon how many years the player stays with the team. Ultimately, the model oversimplifies the complexities of different scenarios as it is hard to include the effects of these contracts in the model. 5. Conclusion This paper finds that, contrary to what numerous sports fans may believe, there is only a moderate correlation between team performance and salary distribution due to the Super Star Effect, when team winning percentage serves as a proxy of team performance. Since the salary given to players is contingent upon player caliber to reflect individual player s performance on the court, the average PER, a metric that measures the average efficiency of players in a team during games, seems to be a more significant factor of team performance than salary distribution due to its stronger correlation with the team winning percentage. A model of team winning percentage is thus

built taking into account both the Robin Hood Coefficient of Salary and Average PER through multiple regression. The results may give managers of NBA teams some insights to balance between rewarding players with high salaries and keeping up the average caliber of players in the team. Overall, PER is a better metric than salary when measuring team success on the court. Thus, more investigation should be conducted by adjusting the PER to reflect its true impact on team performance. In addition, certain qualitative variables such as the support of the city and team location are omitted in the research as it is difficult to quantify their impacts on team success. A more in-depth research that focuses on the impact of PER on team success will be conducted in the future.

REFERENCES Frank, Vincent. NBA Finals: Stephen Curry's Contract Helped Create A Warriors Juggernaut. Forbes, Forbes Magazine, 6 June 2017, www.forbes.com/sites/vincentfrank/2017/06/06/nba-finals-stephen-currys-contract-helpedcreate-a-warriors-juggernaut/#5f03de0a725e. Prada, Mike. NBA to Announce $24 Billion TV Deal. SBNation.com, SBNation.com, 5 Oct. 2014, www.sbnation.com/2014/10/5/6916597/nba-new-tv-deal-espn-turner-24-billion. Zillgitt, Jeff. NBA Salary Cap Expected to Increase in the next Two Seasons. USA Today, Gannett Satellite Information Network, 7 Apr. 2017, www.usatoday.com/story/sports/nba/2017/04/07/nba-salary-capprojections-increase-next-two-seasons/100164170/. Badenhausen, Kurt. Stephen Curry Will Make More Than $80 Million Next Season After Signing Richest Contract In NBA History. Forbes, Forbes Magazine, 1 July 2017, www.forbes.com/sites/kurtbadenhausen/2017/07/01/stephen-curry-to-sign-richest-contract-in-nba-historyworth-201-million/. Coon, Larry. Table of Contents. NBA Salary Cap FAQ, 30 June 2017, www.cbafaq.com/salarycap.htm#q1. Gini, C. (1936). "On the Measure of Concentration with Special Reference to Income and Statistics", Colorado College Publication, General Series No. 208, 73 79. "NBA & ABA Career Leaders and Records for Player Efficiency Rating". Basketball Reference. Retrieved 1 August 2017. Coon, Larry. "25. What are salary cap exceptions?". NBA Salary Cap FAQ. Retrieved July 9, 2017.