The main jump in AI capabilities in recent years is due to the large scale of data, models, and compute used. While this is a powerful tool, it is not always applicable. We are interested in models and applications that can be of use when only small amounts of data are available. For example, processing and understanding ancient languages require models that can generalize with significantly less available data.