liu.seSearch for publications in DiVA
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • oxford
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
WyckoffDiff– A Generative Diffusion Model for Crystal Symmetry
Linköping University, Department of Computer and Information Science, The Division of Statistics and Machine Learning. Linköping University, Faculty of Science & Engineering.ORCID iD: 0000-0003-4161-3631
Linköping University, Department of Physics, Chemistry and Biology, Theoretical Physics. Linköping University, Faculty of Science & Engineering.ORCID iD: 0009-0003-6158-1857
Linköping University, Department of Physics, Chemistry and Biology, Theoretical Physics. Linköping University, Faculty of Science & Engineering.ORCID iD: 0000-0003-0747-1289
Linköping University, Department of Computer and Information Science, The Division of Statistics and Machine Learning. Linköping University, Faculty of Science & Engineering.
Show others and affiliations
2025 (English)In: Proceedings of the 42nd International Conference on Machine Learning, PMLR , 2025, Vol. 267, p. 15130-15147Conference paper, Published paper (Refereed)
Abstract [en]

Crystalline materials often exhibit a high level of symmetry. However, most generative models do not account for symmetry, but rather model each atom without any constraints on its position or element. We propose a generative model, Wyckoff Diffusion (WyckoffDiff), which generates symmetry-based descriptions of crystals. This is enabled by considering a crystal structure representation that encodes all symmetry, and we design a novel neural network architecture which enables using this representation inside a discrete generative model framework. In addition to respecting symmetry by construction, the discrete nature of our model enables fast generation. We additionally present a new metric, Fréchet Wrenformer Distance, which captures the symmetry aspects of the materials generated, and we benchmark WyckoffDiff against recently proposed generative models for crystal generation. As a proof-of-concept study, we use WyckoffDiff to find new materials below the convex hull of thermodynamical stability.

Place, publisher, year, edition, pages
PMLR , 2025. Vol. 267, p. 15130-15147
Series
Proceedings of Machine Learning Research, ISSN 2640-3498
National Category
Condensed Matter Physics Artificial Intelligence
Identifiers
URN: urn:nbn:se:liu:diva-218524ISI: 001693104000283OAI: oai:DiVA.org:liu-218524DiVA, id: diva2:2004331
Conference
ICML 2025, Forty-Second International Conference on Machine Learning, Vancouver Convention Center, Sun. July 13th through Sat. July 19th
Note

Funding: Knut and Alice Wallenberg Foundation (KAW) via the Wallenberg AI, Autonomous Systems and Software Program (WASP); Wallenberg Initiative Material Science for Sustainability (WISE); Swedish Research Council (VR) [2020-05402]; Excellence Center at Linkoping-Lund in Information Technology (ELLIIT); Swedish e-Science Centre (SeRC); Knut and Alice Wallenberg Foundation at the National Supercomputer Centre (NSC); Chalmers Centre for Computational Science and Engineering (C3SE) - Swedish Research Council [2022-06725]

Available from: 2025-10-07 Created: 2025-10-07 Last updated: 2026-09-08
In thesis
1. Deep Learning for the Atomic Scale: Graph Neural Networks and Deep Generative Models with Some Applications to Materials and Molecules
Open this publication in new window or tab >>Deep Learning for the Atomic Scale: Graph Neural Networks and Deep Generative Models with Some Applications to Materials and Molecules
2025 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

The development of artificial intelligence, and in particular machine learning, has seen tremendous success in recent years. The use of machine learning, however, extends to vast application areas outside of those that we encounter in our day-to-day life. One such area is within the natural sciences, where research has shown promising results in using machine learning for modeling of systems of atoms. This is also the type of application for which the methods developed in this thesis are motivated. The thesis investigates and develops both predictive models that can predict properties and simulate these types of systems, and generative models that can propose new potential materials or molecules.

Particular emphasis is put on methods that model data as graphs, and the thesis starts with investigations of graph neural networks (GNNs) designed for predicting material and molecular properties. The performance of these models in the context of high-throughput screenings are put under scrutiny. The performance of GNNs when predicting properties of materials which are only hypothetical and structures which are not completely relaxed is investigated, and the insights are used to suggest a workflow that combines machine learning and conventional high-throughput methods. Additionally, an investigation of so-called knowledge distillation in the context of GNNs for systems of atoms has been performed. This study proposes some simple techniques for improving the performance of this type of GNNs, without sacrificing speed.

The generative modeling techniques developed in the thesis are both more generally applicable and specifically targeting the materials science domain. Among the general methods, the thesis investigates a type of generative autoregressive models where the generation order is a random variable, and develops discriminator guidance for such models. Additionally, a new sequential Monte Carlo algorithm, DDSMC, is developed for general Bayesian inverse problems. A dedicated materials science model, WyckoffDiff, is developed, utilizing a description of materials that explicitly encode information of their symmetries, with the aim of facilitating generation of materials with strict symmetrical properties.

While predictive and generative models can be useful on their own, the study on WyckoffDiff also highlights how they can be used together as parts of a materials discovery pipeline, with predictive models predicting the properties of the materials generated by a generative model like WyckoffDiff.

Place, publisher, year, edition, pages
Linköping: Linköping University Electronic Press, 2025. p. 74
Series
Linköping Studies in Science and Technology. Dissertations, ISSN 0345-7524 ; 2462
National Category
Artificial Intelligence Condensed Matter Physics
Identifiers
urn:nbn:se:liu:diva-218503 (URN)10.3384/9789181181852 (DOI)9789181181845 (ISBN)9789181181852 (ISBN)
Public defence
2025-11-07, Ada Lovelace, B-building, Campus Valla, Linköping, 13:15 (English)
Opponent
Supervisors
Note

Funding: This research was supported by the Excellence Center at Linköping–Lund in Information Technology (ELLIIT), the Swedish Research Council (VR) grant no. 2020-04122, 2024-05011, the Swedish Foundation for Strategic Research (SSF) Grant No. ICA16-0015, the Knut and Alice Wallenberg Foundation (KAW) via the Wallenberg AI, Autonomous Systems, and Software Program (WASP), the Wallenberg Initiative Material Science for Sustainability (WISE) through the joint WASP-WISE project Generative AI models for property to structure materials prediction, and KAW project 2020.0033. Much of the computations were enabled by the Berzelius resource provided by KAW at the National Supercomputer Centre and the Alvis resource provided by the National Academic Infrastructure for Supercomputing in Sweden (NAISS) at Chalmers e-Commons at Chalmers (C3SE) partially funded by the Swedish Research Council through grant agreement no. 2022-06725.

Available from: 2025-10-06 Created: 2025-10-06 Last updated: 2025-10-08Bibliographically approved
2. Crystal Symmetry and Machine Learning for Systematic Materials Discovery
Open this publication in new window or tab >>Crystal Symmetry and Machine Learning for Systematic Materials Discovery
2026 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

Discovering new crystalline materials lies at the frontier of modern materials science, driving innovation in energy storage, catalysis, semiconductors, and beyond. The vastness of the chemical and structural space poses a profound challenge: the number of possible atomic arrangements grows prohibitably large with system size and composition. Traditional first-principles methods such as density functional theory (DFT) have revolutionized materials discovery, but their high computational cost limits large-scale exploration. This work addresses the combinatorial bottleneck by bringing together two complementary dimensions of modern materials discovery: data-driven predictions using machine learning and high-performance computing.

The work presented in this thesis builds on a symmetry-aware representation of crystal structures called protostructures, based on Wyckoff positions: a coordinate free description of symmetry related atomic sites. This formulation transforms the continuous space of atomic coordinates into a discrete and combinatorially enumerable one. We developed a machine learning model, Wren, which is trained on this representation to provide fast estimates of stability and guide exploration toward promising regions of structural space. A GPU-accelerated workflow using machine-learning-based interatomic potentials and parallelized screening allows for the evaluation of billions of candidate structures within practical timeframes.

Building on this framework, the presented work enumerates 39 billion binary and ternary compounds spanning the chemical space from lithium to bromine, identifying over 88,000 new structural prototypes, and about half a million new crystal structures within a stability limit of 100 meV/atom. The approach is further applied to experimentally unresolved powder diffraction data, where it reconstructs crystal structures consistent with measured patterns, demonstrating the workflow’s ability to uncover physically realizable materials beyond known prototypes.

To explore even broader regions of structural complexity, this work introduces WyckoffDiff, a diffusion-based generative model that produces novel, symmetry-consistent protostructures beyond the training distribution, some predicted to be thermodynamically stable.

Since pretrained interatomic potentials form the foundation of this work, their quality was examined through two complementary studies. The first benchmarks their accuracy in reproducing mixing enthalpies across disordered alloys. The second investigates how these potentials capture the topology of potential energy surfaces by probing energy variations along symmetry-constrained pathways, showing how different machine-learning potentials represent local minima and saddle points, and other artifacts. These two benchmarks provides insight into their reliability for structure prediction, and the resulting findings informed the selection and parametrization of models used throughout our screening framework.

Altogether, the work presented in this thesis demonstrates that the combination of coarse grained screening, ML-based interatomic potentials, and high-performance computing can dramatically accelerate the discovery of previously unseen crystal structures. The framework presented in the thesis expands the boundaries of computational materials discovery and represents a step toward a large-scale, perhaps even comprehensive, mapping of all stable crystal structures permitted by chemistry and symmetry.

Place, publisher, year, edition, pages
Linköping: Linköping University Electronic Press, 2026. p. 89
Series
Linköping Studies in Science and Technology. Dissertations, ISSN 0345-7524 ; 2510
National Category
Condensed Matter Physics
Identifiers
urn:nbn:se:liu:diva-221198 (URN)10.3384/9789181184761 (DOI)9789181184754 (ISBN)9789181184761 (ISBN)
Public defence
2026-03-06, Planck, F Building, Campus Valla, Linköping, 09:15 (English)
Opponent
Supervisors
Available from: 2026-02-13 Created: 2026-02-13 Last updated: 2026-02-13Bibliographically approved
3. Materials informatics with large scale materials databases: Semantic modeling and data-driven crystal structure generation
Open this publication in new window or tab >>Materials informatics with large scale materials databases: Semantic modeling and data-driven crystal structure generation
2026 (English)Licentiate thesis, comprehensive summary (Other academic)
Abstract [en]

Materials design has evolved from experimental trial-and-error, to model-based theoretical science and physics-based computational methods, and have now entered the paradigm of data-driven methods. During the past decades physics-based methods such as density functional theory (DFT) has been the driving force of computational materials design, and have been used to produce large sets of materials data by academic groups across the world. Since different databases use different technologies and data formats, the data production has resulted in scattered heterogeneous materials database designs. Data driven design of materials relies on data and methods operating on the data such as machine learning, neural networks, and analysis tools. To enable the full potential of the emerging data operational methods, especially the learning-based methods which commonly improves in correlation to the amount of training data, we need to make the data collectively accessible.

Database integration and interoperability are used to make the data collectively and viably accessible, where ontologies are key to, e.g., make data storages machine interpretable and unification of heterogenous data descriptions. This thesis presents an ontology for units of measures specifically targeting challenges of handling units across databases of computational and experimental data. The ontology is created using definition files part of the property definitions in release 1.2, from the community-driven OPTIMADE standard for a common application programming interface (API) for materials databases. The resulting ontology allows addressing data integration challenges encountered in that effort, which were unsolvable with available tools. These challenges include reference to specific and generalized units that have changed over time, using relevant symbols for different scientific domains, specification of relationships between units, and representation of units not part of System of Units (SI) without defining them in SI units or using SI system conventions.

Developments of structure-to-property machine learning and artificial intelligence (AI) mod-els part of data-driven methods has sped-up traditional physics-based simulation methods. Despite the speed increase of structure-to-property predictions, all possible materials is a massive space which is intractable to screen exhaustively, which leads to the idea of in-verse materials design using property-to-structure prediction. Generative AI models are promising candidates for property-to-structure prediction. Most existing crystal structure generative AI models does not account for symmetry, resulting in generation of high concentration of low-symmetry crystal structures. This thesis presents a generative AI model, capable of generating novel and stable symmetry-based descriptions of crystal structures, which inherently accounts for crystal structure symmetry.

Place, publisher, year, edition, pages
Linköping: Linköping University Electronic Press, 2026. p. 47
Series
Linköping Studies in Science and Technology. Licentiate Thesis, ISSN 0280-7971 ; 2038
National Category
Computer Sciences Artificial Intelligence
Identifiers
urn:nbn:se:liu:diva-226733 (URN)10.3384/9789181186741 (DOI)9789181186734 (ISBN)9789181186741 (ISBN)
Presentation
2026-09-11, Nobel (BL32), B-building, Campus Valla, Linköping, 10:15 (English)
Opponent
Supervisors
Available from: 2026-08-14 Created: 2026-08-14 Last updated: 2026-08-19Bibliographically approved
4.
The record could not be found. The reason may be that the record is no longer available or you may have typed in a wrong id in the address field.

Open Access in DiVA

fulltext(2196 kB)410 downloads
File information
File name FULLTEXT01.pdfFile size 2196 kBChecksum SHA-512
8aa76d08d3c094d879d89fd42b1739aa551c8e327e79e9528cc32a8b8179d9842865d8e24846d318e6233e759f64e2804b8ca7e61120dfed48dbeadf0876f7f0
Type fulltextMimetype application/pdf

Other links

Länk till konferensbidrag / Link to conference proceeding

Authority records

Ekström Kelvinius, FilipAndersson, OskarParackal, Abhijith S.Qian, DongArmiento, RickardLindsten, Fredrik

Search in DiVA

By author/editor
Ekström Kelvinius, FilipAndersson, OskarParackal, Abhijith S.Qian, DongArmiento, RickardLindsten, Fredrik
By organisation
The Division of Statistics and Machine LearningFaculty of Science & EngineeringTheoretical Physics
Condensed Matter PhysicsArtificial Intelligence

Search outside of DiVA

GoogleGoogle Scholar
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

urn-nbn

Altmetric score

urn-nbn
Total: 1616 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • oxford
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf