Kevin A. Bryan

Kevin A. Bryan

@afinetheorem.bsky.social

Assoc Professor of Strategic Management, University of Toronto; Chief Economist, Creative Destruction Lab Toronto; cofounder, AllDayTA; cofounder, NBER Innovation PhD Boot Camp. http://www.kevinbryanecon.com and @AFineTheorem on Twitter

1.8K followers8 following528 posts

We've passed 100 paying institutions for www.alldayta.com! Super exciting to see profs using it in 26 countries, from Ivy League grad courses on down. About to release updates to our AI-driven, prof-in-loop, adaptive quiz: first thing we've done some students dislike (but that's a good thing!) 1/2

alldayta.comAll Day TAAll Day TA is an AI EdTech company focused on higher education that enables professors to build customized AI teaching assistants for their courses. Available 24/7, it provides students with instant, ...

Why is this good? Education researchers refer to Bloom's taxonomy: friction that requires students to explain/teach rather than passively consume increases learning. When you answer wrong on our quizzes, you must explain your thoughts. You pass the quiz when you prove you've learned! 2/2

Folks who know things: what has led so many universities to make speakers "register as suppliers" to get reimbursed? There is no way the law requires this and it's incredibly annoying. I assume the answer is "bureaucrats create bureaucracy", as always, but am I missing something?

Something I didn't expect that we can see in www.alldayta.com data: study effort is so correlated with exams. Across courses, if use on Finals week is "1", relative use on midterm week is .7, and on non-exam weeks .05-.1. For courses with no exam, use always sticks at the lower level.

So much studying & revision in All Day TA classes happens via platform that I can see exact day, time, nature & type of studying students are doing. Gap (in my classes but also for customers) between exam weeks and others makes me thing we need more testing, not less, and more spread out over term.

(Also, we set a new one-class weekly record for use this week! This is a big Principles class at a large public univ, but 39k uses of Intelligent Quiz (an AI-driven adaptive quiz) + 3k direct questions in one week. Wild. Across term- with exams + your good setup- 40-80 uses/student is normal.)

A theorem: AI debate today is a rehash of CP Snow's Two Cultures & the Bluesky-level-hostile response by Leavis. But Snow was right - it *should* be as embarrassing for educated people to not know to Laws of Thermodynamics (or basics of how ML works!) as to not read Shakespeare.

I know it's my company, but All Day TA AI-driven quizzes are so good. Student cheat on all take-home work. How do you get them to learn? Do even better than we used to by having them learn *as they do low-staked hw*. Here's use just this week in a Texas univ course - students really use this. 1/4

View full thread

The path forward for higher ed w/ AI is that teaching *complements* AI. Students learn more using AI, and learn *exactly* what we want to teach, instead of just cheating. Can do even better than pre-AI! (And if you want this - alldayta.com, $100 per term. Super easy.)

alldayta.comAll Day TAAll Day TA is an AI EdTech company focused on higher education that enables professors to build customized AI teaching assistants for their courses. Available 24/7, it provides students with instant, ...

PS - 1) Yes, we're building this out even further. Everything a student does, it should be as close as possible to a tutor who knows what you want to teach sitting by their side. 2) And All Day TA also *reports back to you* summaries of these conversations so you know where students went wrong!

I know it's my company, but All Day TA AI-driven quizzes are so good. Student cheat on all take-home work. How do you get them to learn? Do even better than we used to by having them learn *as they do low-staked hw*. Here's use just this week in a Texas univ course - students really use this. 1/4

Toss my lecture audio, slides, handouts into a module. A crazy AI workflow pulls out learning goals. AI then spins up questions (you can approve or not) from your docs plus context on why students might get them wrong. 2/4

New class on Progress starting tomorrow - I'm amped! Trying to put some rigor from economics, economic history, and philosophy on a topic very much in the air. It will be awesome. (And first class running slides in my all html browser-based slideshow program - details soon!) 1/2

I cover project setup, version control, my daily very simple workflow, what to use for code (Python or R), what AI is high value, why LaTeX, how to do it easily, why all this matters even for qual projects, and links to exactly what to d/l. My own practices were very sloppy-this is a better way. 2/2

I know lots of skepticism about AI here, but let me show you something we put out which I think is a huge improvement for university assignments. This is "Intelligent Quiz", a feature on All Day TA (www.alldayta.com). Assignments now have tons of cheating + little feedback to us or the students. 1/9

View full thread

Honestly, it's a really nice system. As always, everything is all siloed: your content is never used for any training nor leaves your course, and is deleted on demand. The whole alldayta.com is $100 per class section per term - a couple bucks per student on average. AI complements our teaching! 6/6

alldayta.comAll Day TAAll Day TA is an AI EdTech company focused on higher education that enables professors to build customized AI teaching assistants for their courses. Available 24/7, it provides students with instant, ...

PS - An awesome dev of ours was testing the featureand told me "I got it wrong on purpose at first for testing, but then forgot to divide by 2 for expected value until the system brought me there!" Exactly. Imagine this help for the student, and then summed up & reported back to you for each hw!

I know lots of skepticism about AI here, but let me show you something we put out which I think is a huge improvement for university assignments. This is "Intelligent Quiz", a feature on All Day TA (www.alldayta.com). Assignments now have tons of cheating + little feedback to us or the students. 1/9

View full thread

When the students do their assignment, and get a question wrong, the AI forces them to explain their logic, then uses your lectures, handouts, and so on to try to correct mistakes. We then use another AI system to report back to you precisely where students have been going wrong *and why*. 4/6

So instead of "here's a hw, half of you go home and cheat, the rest hand it in and get 7/10, and neither you nor the student fully understands what was done wrong", we deter cheating, ensure everyone 'gets enough questions correct' and thinks through incorrect ones, and report back to the prof. 5/6

I know lots of skepticism about AI here, but let me show you something we put out which I think is a huge improvement for university assignments. This is "Intelligent Quiz", a feature on All Day TA (www.alldayta.com). Assignments now have tons of cheating + little feedback to us or the students. 1/9

The whole deal with All Day TA is "AI for university classes that is pedagogically-sensible, uses your language, and emphasizes your content only". What does that mean for assignments? Questions at level of your class, covering your learning goals, and giving students feedback the way you would. 2/6

That's exactly what we built. Our system already interpreted the learning goals of your course, topic by topic. For question banks, we propose these using our AI, and once you edit and approve, we spin up question banks of varying difficulty. You can manually add, edit or kill these, of course. 3/6

Beautiful Day 1 of school here at U Toronto! Love seeing the students back, and that the undergrads all dress exactly like we did in '98 (I saw 3 Nirvana T-shirts, literally). I'm doing my best to crank up the rigor in my courses - we're taking the role of univs back to '98 also!

(Btw, anedcotes on "the times they are a-changin'", for the student club booths set up on the main drag, the busiest was the Bible Club - I was equally surprised -, second was the Baking Club. The more political booths were very empty...)

View full thread

It does mean we push back against those who deny the possibility of objective research, against those who see the university as a political body, against those who speak and write in an insular way, against those who think public perception of universities is irrelevant. They are wrong.

The rules have a simple basis: do objective research that contributes to the body of human knowledge; teach and publicly communicate that knowledge; be rigorous, neutral, and fair-minded in an attempt to learn true things. It isn't hard.

Getting "big" things done and maintaining existing things are not the same. But why? What causes path dependence? What role do liberty, or particular individuals, or cities, or science, or incentives play? 2/3

Obviously could double this syllabus: who pays for progress, what's different about "moral progress", case studies like Green Revolution, art after Salon des Refusés, end of slavery, the future of AI. Alas! And if you're a Rotman MBA student or alum - you want to take this! 3/3

I've built a bunch of tools this summer to move my whole workflow to using things that are "pure text" so I can use AI on top. Here's the first: a modern paper reader. PDFs suck. Ugly, terribly interface, big files, fixed. I want papers that are adaptive, interactive, pretty. 1/5

View full thread

To create the XML, just drag and drop pdf or latex/bib into the browser, wait a minute, and you have things all set. Occasionally a couple minor manual edits needed, and you need to place your figures in the same folder. Otherwise, that's it - just upload to your website! 4/5

I've built a bunch of tools this summer to move my whole workflow to using things that are "pure text" so I can use AI on top. Here's the first: a modern paper reader. PDFs suck. Ugly, terribly interface, big files, fixed. I want papers that are adaptive, interactive, pretty. 1/5

This code, which runs on one .html file, takes your pdf (or latex/bib), rewrites the whole thing in a pure text XML format, adds in-line references and footnotes, zoomable images, and retains clickable navigations. Plus prettier, and adapts view for phones. But also... 2/5

Because the entire thing is just raw XML, it's easy to build AI tools on top. I have two: an auto "layman's summary", and a really good AI chat with sourcing. Here, it does a calc I don't explicitly do in the paper. And it's using only free models! 3/5