This post is cross-posted from rachel.fast.ai | Continue reading
Answer.AI is a new kind of AI R&D lab which creates practical end-user products based on foundational research breakthroughs. | Continue reading
Summary: recently while fine-tuning a large language model (LLM) on multiple-choice science exam questions, we observed some highly unusual training loss curves. In particular, it appeared the model was able to rapidly memorize examples from the dataset after seeing them just onc … | Continue reading
We’ve noticed an unusual training pattern in fine-tuning LLMs. At first we thought it’s a bug, but now we think it shows LLMs can learn effectively from a single example. | Continue reading
Friends with no previous interest in AI ethics have begun asking me questions in the wake of the release of ChatGPT4, Bard, and Bing Chat. This new generation of large language models has made headlines and sparked widespread debate. To consider the risks posed by new AI applicat … | Continue reading
Moving AI ethics beyond explainability and fairness to empowerment and justice | Continue reading
Proposals for stringent AI model licensing and surveillance will likely be ineffective or counterproductive, concentrating power in unsustainable ways, and potentially rolling back the societal gains of the Enlightenment. The balance between defending society and empowering socie … | Continue reading
This article is the result of a collaboration between philosopher Seth Lazar, AI impacts researcher Arvind Narayanan, and fast.ai’s Jeremy Howard. At fast.ai we believe that planning for our future with AI is a complex topic and requires bringing together cross-disciplinary exper … | Continue reading
I remember the first time I used the v1.0 of Visual Basic. Back then, it was a program for DOS. Before it, writing programs was extremely complex and I’d never managed to make much progress beyond the most basic toy applications. But with VB, I drew a button on the screen, typed … | Continue reading
Today we’re releasing our new course, From Deep Learning Foundations to Stable Diffusion, which is part 2 of Practical Deep Learning for Coders. | Continue reading
“The limits of my language mean the limits of my world.” — Ludwig Wittgenstein | Continue reading
This post is cross-posted from rachel.fast.ai. Going forward, I will be blogging at rachel.fast.ai. I still believe deeply in the mission of fast.ai, but I’m currently focused on studying immunology. | Continue reading
Last year, I became captivated by a new topic in a way that I hadn’t felt since I first discovered machine learning | Continue reading
4 videos from Practical Deep Learning for Coders Part 2, 2022 have been released as a special early preview of the new course. | Continue reading
The University of Queensland has opened the course to late registrations, if you want to join the rest of the course live: register here. | Continue reading
Signups might not be available any more. If you are able to do a late signup, note that you may miss doing the first lesson live (although you can watch the recording.) | Continue reading
Three years ago we pioneered Deep Learning from the Foundations, an in depth course that started right from the foundations—implementing and GPU-optimising matrix multiplications and initialisations—and covered from scratch implementations of all the key applications of the fasta … | Continue reading
My husband Jeremy and I never intended to homeschool, and yet we have now, unexpectedly, committed to homeschooling long-term. Prior to the pandemic, we both worked full-time in careers that we loved and found meaningful, and we sent our daughter to a full-day Montessori school. … | Continue reading
Jupyter notebooks don’t work with git by default. With nbdev2, the Jupyter+git problem has been totally solved. It provides a set of hooks which provide clean git diffs, solve most git conflicts automatically, and ensure that any remaining conflicts can be resolved entirely withi … | Continue reading
Today we’re excited to announce that we’ve teamed up with Quarto to give nbdev superpowers. nbdev offers Python programmers a common set of tools for using Jupyter notebooks to: | Continue reading
Today we’re releasing Practical Deep Learning for Coders 2022—a complete from-scratch rewrite of fast.ai’s most popular course, that’s been two years in the making. Previous fast.ai courses have been studied by hundreds of thousands of students, from all walks of life, from all p … | Continue reading
These are notes I took whilst preparing a paper on mask efficacy from Nov 2021 to Jan 2022. In the end, I gave up on the paper, because I felt like people had given up on masks, so there wasn’t much point in finishing it. I’ve decided to publish these notes in the hope some peopl … | Continue reading
“All research is qualitative; some is also quantitative” Harvard Social Scientist and Statistician Gary King | Continue reading
When the USA government switched to facial identification service ID.me for unemployment benefits, the software failed to recognize Bill Baine’s face. While the app said that he could have a virtual appointment to be verified instead, he was unable to get through. The screen had … | Continue reading
On the surface, I may seem into math: I have a math PhD, taught a graduate computational linear algebra course, co-founded AI research lab fast.ai, and even go by the twitter handle @math_rachel. | Continue reading
I have been organizing and facilitating a series of Ethics Workshops for the Australian Data Science Network, featuring lightning talks by Australian experts on a range of topics related to data science ethics, including machine learning in medicine, explainability, Indigenous-le … | Continue reading
The phrase “data science for social good” is a broad umbrella, ambiguously defined. As many others have pointed out, the term often fails to specify good for whom. Data science for social good can be used to refer to: nonprofits increasing their impact through more effective data … | Continue reading
Things can go disastrously wrong in data science and machine learning projects when we undervalue data work, use data in contexts that it wasn’t gathered for, or ignore the crucial role that humans play in the data science pipeline. A new multi-university centre focused on Inform … | Continue reading
My colleague Dr Uri Manor was a senior author on a study in March this year which has become the most discussed paper in the history of Circulation Research and is in the top 0.005% of discussed papers across all topics. That’s because it got widely picked up by anti-vaxx groups … | Continue reading
Summary: Statistical tests need to be paired with proper data and study design to yield valid results. A recent review paper on Long Covid in children provides a useful example of how researchers can get this wrong. We use causal diagrams to decompose the problem and illustrate w … | Continue reading