• Ma chevron_right

      A Big and Embarrassing Challenge to DSGE Models

      Alex Tabarrok · tests.marevalo.net / Marginal REVOLUTION · Thursday, 3 November, 2022 - 11:25 · 4 minutes

    Dynamic stochastic general equilibrium (DSGE) models are the leading models in macroeconomics. The earlier DSGE models were Real Business Cycle models and they were criticized by Keynesian economists like Solow , Summers and Krugman because of their non-Keynesian assumptions and conclusions but as DSGE models incorporated more and more Keynesian elements this critique began to lose its bite and many young macroeconomists began to feel that the old guard just weren’t up to the new techniques. Critiques of the assumptions remain but the typical answer has been to change assumption and incorporate more realistic institutions into the model. Thus, most new work today is done using a variant of this type of model by macroeconomists of all political stripes and schools.

    Now along comes two statisticians, Daniel J. McDonald and the acerbic Cosma Rohilla Shalizi. McDonald and Shalizi subject the now standard Smet-Wouters DSGE model to some very basic statistical tests . First, they simulate the model and then ask how well can the model predict its own simulation? That is, when we know the true model of the economy how well can the DSGE discover the true parameters? [The authors suggest such tests haven’t been done before but that doesn’t seem correct, e.g. Table 1 here . Updated, AT] Not well at all.

    If we take our estimated model and simulate several centuries of data from it, all in the stationary regime, and then re-estimate the model from the simulation, the results are disturbing. Forecasting error remains dismal and shrinks very slowly with the size of the data. Much the same is true of parameter estimates, with the important exception that many of the parameter estimates seem to be stuck around values which differ from the ones used to generate the data. These ill-behaved parameters include not just shock variances and autocorrelations, but also the “deep” ones whose presence is supposed to distinguish a micro-founded DSGE from mere time-series analysis or reduced-form regressions. All this happens in simulations where the model specification is correct, where the parameters are constant, and where the estimation can make use of centuries of stationary data, far more than will ever be available for the actual macroeconomy.

    Now that is bad enough but I suppose one might argue that this is telling us something important about the world. Maybe the model is fine, it’s just a sad fact that we can’t uncover the true parameters even when we know the true model. Maybe but it gets worse. Much worse.

    McDonald and Shalizi then swap variables and feed the model wages as if it were output and consumption as if it were wages and so forth. Now this should surely distort the model completely and produce nonsense. Right?

    If we randomly re-label the macroeconomic time series and feed them into the DSGE, the results are no more comforting. Much of the time we get a model which predicts the (permuted) data better than the model predicts the unpermuted data. Even if one disdains forecasting as end in itself, it is hard to see how this is at all compatible with a model capturing something — anything — essential about the structure of the economy. Perhaps even more disturbing, many of the parameters of the model are essentially unchanged under permutation, including “deep” parameters supposedly representing tastes, technologies and institutions.

    Oh boy. Imagine if you were trying to predict the motion of the planets but you accidentally substituted the mass of Jupiter for Venus and discovered that your model predicted better than the one fed the correct data. I have nothing against these models in principle and I will be interested in what the macroeconomists have to say, as this isn’t my field, but I can’t see any reason why this should happen in a good model. Embarrassing.

    Addendum : Note that the statistical failure of the DSGE models does not imply that the reduced-form, toy models that say Paul Krugman favors are any better than DSGE in terms of “forecasting” or “predictions”–the two classes of models simply don’t compete on that level–but it does imply that the greater “rigor” of the DSGE models isn’t buying us anything and the rigor may be impeding understanding–rigor mortis as we used to say.

    Addendum 2 : Note that I said challenge. It goes without saying but I will say it anyway, the authors could have made mistakes. It should be easy to test these strategies in other DSGE models.

    The post A Big and Embarrassing Challenge to DSGE Models appeared first on Marginal REVOLUTION .

    • Ma chevron_right

      Redistribution and credit card debt

      Tyler Cowen · tests.marevalo.net / Marginal REVOLUTION · Wednesday, 2 November, 2022 - 06:32 · 1 minute

    Is Chase Sapphire a Pareto improvement, or does it also involve redistribution?  Here is a new paper on that topic:

    We study credit card rewards as an ideal laboratory to quantify the cross-subsidy from naive to sophisticated consumers in retail financial markets. Using granular data on the near universe of credit card accounts in the United States, we find that sophisticated consumers profit from reward credit cards at the expense of naive consumers who lose money both in absolute terms and relative to classic cards. We estimate an aggregate annual cross-subsidy of $15.5 billion. Notably, our results are not driven by income—while sophisticated high-income consumers benefit the most, naive high-income consumers pay the most. Banks lure consumers into the use of reward cards by offering lower interest rates than on comparable classic cards and bank profits are highest for borrowers in the middle of the credit score distribution. We show that credit card rewards transfer wealth from less to more educated, from poorer to richer, from rural to urban, and from high to low minority areas, thereby widening existing spatial disparities.

    The authors are Sumit Agarwal, Andrea Presbitero, André F. Silva, and Carlo Wix. I guess I am going to continue using my Sapphire card, are you?

    Via Arpit Gupta .

    The post Redistribution and credit card debt appeared first on Marginal REVOLUTION .

    • Ma chevron_right

      Further evidence on role models

      Tyler Cowen · tests.marevalo.net / Marginal REVOLUTION · Tuesday, 1 November, 2022 - 06:51 · 1 minute

    Leveraging the Tennessee STAR class size experiment, we show that Black students randomly assigned to at least one Black teacher in grades K–3 are 9 percentage points (13 percent) more likely to graduate from high school and 6 percentage points (19 percent) more likely to enroll in college compared to their Black schoolmates who are not. Black teachers have no significant long-run effects on White students. Postsecondary education results are driven by two-year colleges and  concentrated among disadvantaged males. North Carolina administrative data yield similar findings, and analyses of mechanisms suggest role model effects may be one potential channel.

    That is from a new AER paper by Seth Gershenson, Cassandra M. D. Hart, Joshua Hyman, Constance A. Lindsay and Nicholas W. Papageorge, “The Long-Run Impacts of Same-Race Teachers.”  Here are various ungated version s.  Just to be clear, I don’t consider this a justification for any particular set of policies.  I do see it as extra reason for the successful to be visible and to work hard!

    The post Further evidence on role models appeared first on Marginal REVOLUTION .