r/semanticweb • u/freemind03__ • 17d ago

Transforming unstructured text into organized knowledge

I'm working on a project involving Augmentation Intelligence. Actually trying to transform unstructured text into organized knowledge format.

LLMs could work, but the hard part is handling language nuances.

Example problem: "It's been much warmer in recent years"

How we can handle text like this? Like Fuzzy Logic?

10 Upvotes

92% Upvoted

9 comments sorted by

10

u/Old-Tone-9064 17d ago

Short answer for low-effort decent results: upper ontology + SHACL shapes. The LLM outputs (triple generation over unstructured text) will be severely constrained in a good way.

Resources:

- https://nemo-ufes.github.io/gufo/

- https://github.com/nemo-ufes/gufoshapes

- https://arxiv.org/abs/2603.20948

For better results, you need to do an ontological analysis of the domain, resulting in a domain ontology (with corresponding SHACL shapes).

1

u/freemind03__ 17d ago

Thank you!

Is it also possible to represent all knowledge using triples?

Do we need to define a domain ontology first?

1

u/Old-Tone-9064 16d ago

It depends on what you mean by "all knowledge". If you are working with a well-defined set of text documents, a stable domain ontology should be possible.

1

u/freemind03__ 16d ago

I am working on a very ambitious project. Right now, I am focusing on the ingestion layer; I need a way to transform any piece of knowledge into a unified space where all the input knowledge resides. However, the data needs to "speak the same language" in order to convert the infinite nuances of human language. I cannot define every single domain ontology.

1

u/Old-Tone-9064 16d ago

So you can go with an upper ontology and see how it goes.

1

u/freemind03__ 16d ago

I think is the way.

But I think have a Domain Ontology is for logical reasoning by computer.

But if computer just have to represent and not reasoning?

Human should navigate in these amounts of knowledge stored

1

u/Successful-Farm5339 17d ago

I built this to do it - main use case is for RAG but works for anything https://github.com/fabio-rovai/open-ontologies

1

u/AmbitiousSet5 17d ago

Check out sigmakee.dev . The SUMO language is designed to handle this type of thing.