Discussion about this post

User's avatar
FinallyInCrypto's avatar

Thank you for this new Substack. This is a great idea. And best wishes!

Luis Guirola's avatar

I haven’t read the whole column yet, but let me say that I think this effort is extremely useful. Let me tell you my story.

Earlier in my career I tried to exploit my knowledge of econometrics data science and statistics to do applied work. My statistical education went a bit beyond the standard econometrics core —I took classes in predictive modeling and Bayesian statistics with the stat folks. In the stats departament the focus was really applied, so my hope was that I would likely be able to apply those techniques to new problems.

Now, when I came back to the econ world I found that The applied people were hostile to any innovation that was not implemented smoothly in Stata (“why do you partially pool your fixed effects in a hierarchical model? This is very unconventional” “what’s the point of this Gaussian process? Just do OLS”). Nobody wants to ready the methodological section of your paper.

My hope was that I would be more successful if I shopped among the econometrics people. After all, econometrics is supposed to be about developing methods that are ready to use for economic questions, so probably my applied peers would be more receptive to these. However, attending econometric sessions in conferences was much worse: there was exactly zero focus on explaining why this was useful to solve this or that particular problem, it was all about relaxing this or that particular assumption. It seemed written for other econometricians, never with the users of those techniques in mind. So, the hope to use one these new estimators to do produce a new paper seems hopeless.

A related problem is implementation: even if they show that their estimator are useful, econometrics people rarely any software that can be used by applied researchers. This is not surprising as this is a lot of work and hard to maintain, probably not sufficiently recognized within the Econ world. Consider the big contrast with the work that Gelman and his coauthors have done with the Stan environment for Bayesian statistics.

In that respect, I think the work of new DID literature should be the standard: taking a problem in applied research, showing that the standard method delivers bad results, and underscoring how your new estimator does better; they also have developed great if R packages and tutorials and have a webpage for it.

With that backup, it is much easier to people like me to use such estimators in applied research

1 more comment...

No posts

Ready for more?