7th Neural Scaling Laws workshop

CERC - Autonomous Artificial Intelligence and Cerebras Systems

We're organizing the 7th workshop about machine learning models, scaling laws, and much more, through presentations, posters and discussions

Courtyard Vienna Prater/Messe

<h3><strong><strong>Practical information</strong></strong></h3><p>The 7th NSLW will be help in person in Vienna. We will have in person and remote presentations.</p><p><br></p><h3><strong><strong>If you book an onsite ticket, please make sure you'll attend the workshop onsite as we have a limited number of spots.</strong></strong></h3><p><br></p><h3><strong><strong>For remote attendance, please check our remote </strong></strong><a href="https://us02web.zoom.us/webinar/register/WN_jBQCC1WyRhK9BZ2flMujFg" title="https://us02web.zoom.us/webinar/register/WN_jBQCC1WyRhK9BZ2flMujFg" target="_blank" data-msys-clicktrack="0" rel="nofollow noopener noreferrer"><strong><strong>registration page</strong></strong></a><strong><strong>.</strong></strong></h3><h3><br></h3><p>Schedule will be soon available here and will be update soon.</p><p><br></p><h3>Main topic</h3><p>This is the 7th workshop in the workshop series that started Oct 2021, motivated by recent advances in the rapidly developing area of foundation models - large-scale neural networks, pretrained in an unsupervised way on very large and diverse datasets. Such models often demonstrate significant improvement in their few-shot generalization abilities, as compared to their smaller-scale counterparts, across a wide range of downstream tasks - what one could call a "transformation of quantity into quality" or an "emergent behavior".</p><p>Rapid increase in generalization capabilities of such models is an important step towards a long-standing objective of achieving Artificial General Intelligence (AGI). By AGI here we mean literally a "general", i.e. broad, versatile AI capable of quickly adapting to a wide range of situations and tasks, both novel and those encountered before - i.e. achieving a good stability (memory) vs plasticity (adaptation) trade-off, using the continual learning terminology.</p><p>The goal of the workshop series is to provide a forum for discussion of the most recent advances in large-scale pretrained models, focusing specifically on empirical scaling laws of such systems' performance, with increasing compute, model size, and pretraining data (power laws, "broken" power laws, "phase transitions", etc). We will also explore the trade-off between the increasing AI capabilities and AI safety/alignment with human values, considering a range of evaluation metrics beyond the predictive performance. These topics are also closely related to transfer-, continual- and meta-learning, as well as out-of-distribution generalization, robustness and invariant/causal predictive modeling.</p>

Our {communityGuidelinesLink} describe the sort of content we prohibit on Eventbrite. If you suspect an event may be in violation, you can report it to us so we can investigate.

To report other categories of prohibited or illegal content, submit {link}

7th Neural Scaling Laws workshop

More events from CERC - Autonomous Artificial Intelligence and Cerebras Systems

Discover more events from CERC - Autonomous Artificial Intelligence and Cerebras Systems, from Science & Tech to other experiences you might love.

7th Neural Scaling Laws workshop

More events from CERC - Autonomous Artificial Intelligence and Cerebras Systems

Discover more events from CERC - Autonomous Artificial Intelligence and Cerebras Systems, from Science & Tech to other experiences you might love.

More Science & Tech events

Browse more Science & Tech events with different dates, prices, and formats to find your next great experience.