Das semantische Web, SS 2008, , AG Wissensbasierte System, TU KL. 1 AG Wissensbasierte Systeme © 2008 AGD The Semantic Desktop Leo Sauermann DFKI GmbH Universität Kaiserslautern

© 2006 AGDDas semantische Web, SS 2006, , AG Wissensbasierte System, TU KL. 2 AG Wissensbasierte Systeme

© 2006 AGDDas semantische Web, SS 2006, , AG Wissensbasierte System, TU KL. 3 AG Wissensbasierte Systeme Bringen sie das zusammen?

© 2006 AGDDas semantische Web, SS 2006, , AG Wissensbasierte System, TU KL. 4 AG Wissensbasierte Systeme Der Desktop nicht, aber das Web.

© 2006 AGDDas semantische Web, SS 2006, , AG Wissensbasierte System, TU KL. 5 AG Wissensbasierte Systeme

© 2006 AGDDas semantische Web, SS 2006, , AG Wissensbasierte System, TU KL. 6 AG Wissensbasierte Systeme <rdf:RDF xmlns:out=" xmlns:rdf=" > Leo Sauermann

© 2006 AGDDas semantische Web, SS 2006, , AG Wissensbasierte System, TU KL. 7 AG Wissensbasierte Systeme Personal Information Management Trivial: Es geht um Termine, Kontakte und E- Mails Definition von Richard Boardman PIM can be defined as the management of personal information (information owned by an individual, and under their direct control) as performed by the owning individual. in mehreren Anwendungen der Kontext geht verloren

© 2006 AGDDas semantische Web, SS 2006, , AG Wissensbasierte System, TU KL. 8 AG Wissensbasierte Systeme Persönliches Informationsmanagement (PIM) Problem: Ein Thema ist über viele Dateien und Anwendungen verteilt Menschen haben mentale Modelle ihrer Umgebung Dokumente sind mit den Themen im persönlichen Informationsmodell verbunden Jeder macht PIM Warum weiß das Window Manager/Betriebssystem das nicht? the CID project Documents Papers Projects CID Research files s Inbox Todo SAP CID-proj Karlsruhe contacts Claudia Stern Dirk Hagemann Klaus Nord CID Topic Claudia Project Who Karlsruhe Task Management Where Dirk CID slides Document

© 2006 AGDDas semantische Web, SS 2006, , AG Wissensbasierte System, TU KL. 9 AG Wissensbasierte Systeme This is an old idea Memex (Vannevar Bush) 1945: A memex is "a device in which an individual stores all his books, records, and communications, and which is mechanized so that it may be consulted with exceeding speed and flexibility" (As we may think) Open Hypertext System (Doug Engelbart) The open hyperdocument system (OHS) is a standards-based, open source framework for developing collaborative, knowledge management applications. Its primary objective is to support the creation, organization, and maintenance of Dynamic Knowledge Repositories (DKR). XANADU: DEEP INTERCONNECTION, INTERCOMPARISON AND RE-USE. Since 1960, we have fought for a world of deep electronic documents– with side-by-side intercomparison and frictionless re-use of copyrighted material. WE FIGHT ON.

© 2006 AGDDas semantische Web, SS 2006, , AG Wissensbasierte System, TU KL. 10 AG Wissensbasierte Systeme Semantic Web als enabler Datensumpf eines Desktop Arbeitsplatzes Semantic Desktop

© 2006 AGDDas semantische Web, SS 2006, , AG Wissensbasierte System, TU KL. 11 AG Wissensbasierte Systeme Definition A Semantic Desktop is a device in which an individual stores all her digital information like documents, multimedia and messages. These are interpreted as Semantic Web resources, each is identified by a Uniform Resource Identifier (URI) and all data is accessible and queryable as RDF graph. Resources from the web can be stored and authored content can be shared with others. Ontologies allow the user to express personal mental models and form the semantic glue interconnecting information and systems. Applications respect this and store, read and communicate via ontologies and Semantic Web protocols. The Semantic Desktop is an enlarged supplement to the user's memory. Leo Sauermann, Ansgar Bernardi, Andreas Dengel: Overview and Outlook on the Semantic Desktop. Proceedings of the 1st Workshop on The Semantic Desktop at the ISWC 2005 Conference.

© 2006 AGDDas semantische Web, SS 2006, , AG Wissensbasierte System, TU KL. 12 AG Wissensbasierte Systeme Ziele eines Semantic Desktop Bereitstellung von Information über Anwendungsgrenzen hinweg Aufbauend auf Semantic Web Standards URI RDF RDF/S HTTP Integriertes Informationsmanagement Semantische Kommunikation und Zusammenarbeit

© 2006 AGDDas semantische Web, SS 2006, , AG Wissensbasierte System, TU KL. 13 AG Wissensbasierte Systeme Resources on the Semantic Desktop Every resource is identified by a URI file file:///C:/Dokumente%20und%20Einstellungen/

© 2006 AGDDas semantische Web, SS 2006, , AG Wissensbasierte System, TU KL. 14 AG Wissensbasierte Systeme All is RDF Example: me Note: URI, Structured a foaf:Person; foaf:currentProject ; foaf:family_name "Sauermann"; foaf:firstName "Leo"; foaf:workInfoHomepage ; vcard:address [ a vcard:AddressPostal ; vcard:streetAddress "Pirmasenser Strasse 18" vcard:locality "Kaiserslautern" ; vcard:postalcode "67655" ; vcard:country "Deutschland" ; ] ; kiss:kissed ;.

© 2006 AGDDas semantische Web, SS 2006, , AG Wissensbasierte System, TU KL. 15 AG Wissensbasierte Systeme implementations

© 2006 AGDDas semantische Web, SS 2006, , AG Wissensbasierte System, TU KL. 16 AG Wissensbasierte Systeme gnowsis 0.9 gnowsis is an open source project led by DFKI gnowsis.opendfki.de Is used by several researchers inside and outside DFKI to run experiments Can be used and extended as part of your diploma, bachelor or PhD thesis.

© 2006 AGDDas semantische Web, SS 2006, , AG Wissensbasierte System, TU KL. 17 AG Wissensbasierte Systeme Semantic Applications Desktop Search Gnowsis Server Aperture Crawlers Outlook server filesystem Outlook PIMO Editor Crawler Ont. Matching Files Gui invocationTagging Clustering Desktop ApplicationsApplication Plugins Sesame2 Repository Resource Store PIMO Store Configuration Store Service Store Domain Ontologies Lucene Index Personal Wiki Web Interfaces

© 2006 AGDDas semantische Web, SS 2006, , AG Wissensbasierte System, TU KL. 18 AG Wissensbasierte Systeme Data-flow between services Data Persons files and s RDF adapting to RDF matching to PIMO PIMO Aperture.sf.net crawling framework converts all data to RDF Alignment analyzes files and s (and more) matching to existing things creating new things User Interfaces read/write PIMO Documents Papers Projects CID Research Files s Inbox Todo SAP CID-proj Karlsruhe Contacts Claudia Stern Dirk Hagemann Klaus Nord

© 2006 AGDDas semantische Web, SS 2006, , AG Wissensbasierte System, TU KL. 19 AG Wissensbasierte Systeme Convert Leo from Address-Book to RDF <rdf:RDF xmlns:nco=" xmlns:rdf=" > Leo Sauermann adapting to RDF desktop://outlook/contact/ECD4B993 PersonContact is a Leo Sauermann fullname Microsoft Outlook done with

© 2006 AGDDas semantische Web, SS 2006, , AG Wissensbasierte System, TU KL. 20 AG Wissensbasierte Systeme Integrate data desktop://outlook/contact/ECD4B993 Leo Sauermann fullname attends High probability that is depicted on. desktop://outlook/appointment/744A T09:00: T17:00:00 FOAF Camp title dtstart dtend file://home/photos/DSC0042.jpg T11:24:00 dateTimeOriginal between Is Leo depicted? YesNo

© 2006 AGDDas semantische Web, SS 2006, , AG Wissensbasierte System, TU KL. 21 AG Wissensbasierte Systeme Example: Semantic Desktop Photo Archive Leo Leo with Mobile_phone, Laptop near Enschede. During FoafCamp. Mobile_phone Laptop Leo Sauermann desktop://outlook/contact/ECD4B993 a Person Enschede a City

© 2006 AGDDas semantische Web, SS 2006, , AG Wissensbasierte System, TU KL. 22 AG Wissensbasierte Systeme Nepomuk Nepomuk is an EU project. Its topic is the Social Semantic Desktop. DFKI coordinates. Nepomuk Nepomuk is an EU project. Its topic is the Social Semantic Desktop. DFKI coordinates. Personal Semantic Wiki for note-taking Terms Types Relation types Relations RDF We can use a personal semantic wiki everywhere: comments, notes, documents, websites, blogs, e- mails, …

© 2006 AGDDas semantische Web, SS 2006, , AG Wissensbasierte System, TU KL. 23 AG Wissensbasierte Systeme Semantic Wiki – User Interface Kaukoluwiki open source Assistance system Automatic annotation Malte Kiesel, Kaukolu: Hub of the Semantic Corporate Intranet Express thoughts using free text

© 2006 AGDDas semantische Web, SS 2006, , AG Wissensbasierte System, TU KL. 24 AG Wissensbasierte Systeme Application plugins, mini-applications, mashups tagging s Idea: Let people use their existing applications to get their knowledge work done drop-box

© 2006 AGDDas semantische Web, SS 2006, , AG Wissensbasierte System, TU KL. 25 AG Wissensbasierte Systeme Application: Drop Box Helps filing information uses PIMO structures concepts and folders Knows the users model and is trained by using it process flow files are stored into a Drop-Box folder files are text-analysed and possible target folders are suggested Drop-Box user interface shows user selects a folder, classify files are moved and classified Learns from the user doc: … EPOS … Project:Epos EPOS, DFKI, Maus, … PIMO of Paul =

© 2006 AGDDas semantische Web, SS 2006, , AG Wissensbasierte System, TU KL. 26 AG Wissensbasierte Systeme search

© 2006 AGDDas semantische Web, SS 2006, , AG Wissensbasierte System, TU KL. 27 AG Wissensbasierte Systeme Data Enrichment through Alignment Entity Linkage Example for identity matching rdf:type Publication...author Steven Kean...author Mark Schroeder rdf:type Publication author Steaven Kean author James Derrick author Mark Schroeder results in file:///425.pdf/person_1...similar_to file:///686.pdf/person_1 similar based on use, but different writing Probabilistic entity linkage for heterogeneous information spaces. Ekaterini Ioannou, Claudia Niederee, Wolfgang Nejdl. In CAiSE, (2008). (to appear)

© 2006 AGDDas semantische Web, SS 2006, , AG Wissensbasierte System, TU KL. 28 AG Wissensbasierte Systeme Learning from the users behavior Plugins gather user actions Elicitation of task concepts Notification of GUI Applications shows documents, people, projects, topics relevant to current work search documents via context: I saw it after working with Dirk pro-active non-obtrusive assistance Bayesian Network UA Domain Wf Task NOP Wf Task TaCo Domain UA NOP PIM Maus PIM Mid DFKI KM PIM Upper PIM Basic A Context Model for Personal Knowledge Management Applications Sven Schwarz (2006)

© 2006 AGDDas semantische Web, SS 2006, , AG Wissensbasierte System, TU KL. 29 AG Wissensbasierte Systeme SeMouse Annotation of documents using the middle mouse button Works with Word, Browser, PDF, … Can be integrated with other frameworks (gnowsis) Sergio F. Anzuola click!

© 2006 AGDDas semantische Web, SS 2006, , AG Wissensbasierte System, TU KL. 30 AG Wissensbasierte Systeme EU Projekt Dauer – Förderung 11.5 M Gesamtbudget 17.1 M Ziele Standardisierung innerhalb Europas Beitrag zur Vision Europas als wettbewerbsfähigste Wissensgesellschaft Kombiniert alle vorgestellten Ansätze Kontakt Webseitehttp://nepomuk.semanticdesktop.orghttp://nepomuk.semanticdesktop.org KoordinatorDr. Ansgar Bernardi Die Zukunft des Semantic Desktop

© 2006 AGDDas semantische Web, SS 2006, , AG Wissensbasierte System, TU KL. 31 AG Wissensbasierte Systeme KDE4.0 has this technology built in Tagging of files, s,contacts, … System-wide tagging Desktop search engine is based on RDF and semantic web You can do much more than tagging with this!

© 2006 AGDDas semantische Web, SS 2006, , AG Wissensbasierte System, TU KL. 32 AG Wissensbasierte Systeme Beagle++ Semantische Desktop-Suchmaschine Index enthält Metadaten und Kontext Optimiertes Ranking der Ergebnisse Relationen Forschungsprojekt von L3S Open Source, Java und C# Sesame DB Für Linux/Gnome/Beagle sehr zu empfehlen: der VM download

© 2006 AGDDas semantische Web, SS 2006, , AG Wissensbasierte System, TU KL. 33 AG Wissensbasierte Systeme DBin ein verteilter Semantic Desktop Suche nach Information Kollektiv arbeiten

© 2006 AGDDas semantische Web, SS 2006, , AG Wissensbasierte System, TU KL. 34 AG Wissensbasierte Systeme Open IRIS verwandte Daten

© 2006 AGDDas semantische Web, SS 2006, , AG Wissensbasierte System, TU KL. 35 AG Wissensbasierte Systeme Haystack Very good user interface Much research done

© 2006 AGDDas semantische Web, SS 2006, , AG Wissensbasierte System, TU KL. 36 AG Wissensbasierte Systeme data extraction

© 2006 AGDDas semantische Web, SS 2006, , AG Wissensbasierte System, TU KL. 37 AG Wissensbasierte Systeme Extracting Information <rdf:RDF xmlns:out=" xmlns:rdf=" > Leo Sauermann

© 2006 AGDDas semantische Web, SS 2006, , AG Wissensbasierte System, TU KL. 38 AG Wissensbasierte Systeme structured files – quite simple.doc (author, title).xml.oo mp3 (album,..).jpg more file formats time aperture camera

© 2006 AGDDas semantische Web, SS 2006, , AG Wissensbasierte System, TU KL. 39 AG Wissensbasierte Systeme structured data sources address books server using IMAP system like calendar weird idea: all of them: data extracted using API two approaches: 1) crawl everything 2) access data sources live – virtual graphs

© 2006 AGDDas semantische Web, SS 2006, , AG Wissensbasierte System, TU KL. 40 AG Wissensbasierte Systeme crawl everything Microsoft Outlook convert

© 2006 AGDDas semantische Web, SS 2006, , AG Wissensbasierte System, TU KL. 41 AG Wissensbasierte Systeme Microsoft Outlook adapter virtual graph user asks question query language graph only answers the question

© 2006 AGDDas semantische Web, SS 2006, , AG Wissensbasierte System, TU KL. 42 AG Wissensbasierte Systeme Microsoft Outlook adapter rdf query languages find ( s, p, o) cbd (s) SPARQL (…)

© 2006 AGDDas semantische Web, SS 2006, , AG Wissensbasierte System, TU KL. 43 AG Wissensbasierte Systeme rdf query languages are your glasses

© 2006 AGDDas semantische Web, SS 2006, , AG Wissensbasierte System, TU KL. 44 AG Wissensbasierte Systeme query languages SeRQL RDQL …. SPARQL is a superset

© 2006 AGDDas semantische Web, SS 2006, , AG Wissensbasierte System, TU KL. 45 AG Wissensbasierte Systeme the virtual graph is never stored it is created on demand when a query is fired virtual?

© 2006 AGDDas semantische Web, SS 2006, , AG Wissensbasierte System, TU KL. 46 AG Wissensbasierte Systeme known subject querying - easy SPARQL SELECT ?name, ? WHERE ( x:name ?name). ( x: ? ). Jena – query engine does this find ( x:name ?name). find ( x: ? ).

© 2006 AGDDas semantische Web, SS 2006, , AG Wissensbasierte System, TU KL. 47 AG Wissensbasierte Systeme logic behind

© 2006 AGDDas semantische Web, SS 2006, , AG Wissensbasierte System, TU KL. 48 AG Wissensbasierte Systeme Java implementation using the Jena framework by HP find ( x:name ?name). find ( x: ? ).

© 2006 AGDDas semantische Web, SS 2006, , AG Wissensbasierte System, TU KL. 49 AG Wissensbasierte Systeme search for subject Problem SELECT ?uri WHERE (?uri x:name Leo). use an index to lookup if this index is not in your datasource - bad thing

© 2006 AGDDas semantische Web, SS 2006, , AG Wissensbasierte System, TU KL. 50 AG Wissensbasierte Systeme reordering SELECT ? WHERE (?who x: ? ). (?who x:name Leo). query reordering – evaluate unbound triples last Jena ARQ find ( ?who x:name Leo) ?who = find ( x: ? ).

© 2006 AGDDas semantische Web, SS 2006, , AG Wissensbasierte System, TU KL. 51 AG Wissensbasierte Systeme complex queries Addresses of all Austrians SELECT ? WHERE (?who x:address ?adress). (?address x:country Austria). (?who x: ? ). reordering, index, ??code?? performance problems some queries are not possible to run

© 2006 AGDDas semantische Web, SS 2006, , AG Wissensbasierte System, TU KL. 52 AG Wissensbasierte Systeme summary on virtual graphs invest much time sit it out wait until big company ( ) implements SPARQL Leo Sauermann, Sven Schwarz Gnowsis Adapter Framework: Treating Structured Data Sources as Virtual RDF Graphs. or use a simpler query language: cbd/DESCRIBE

© 2006 AGDDas semantische Web, SS 2006, , AG Wissensbasierte System, TU KL. 53 AG Wissensbasierte Systeme cbd or describe – a simpler way to query cbd ( urn:leo:kaiserslautern, someoptions ) also part of SPARQL: DESCRIBE return graph <rdf:RDF xmlns:out=" xmlns:rdf=" > Leo Sauermann

© 2006 AGDDas semantische Web, SS 2006, , AG Wissensbasierte System, TU KL. 54 AG Wissensbasierte Systeme Concise Bounded Resource Descriptions CBD The subgraph around a resource A concise bounded description of a resource is a body of knowledge about a named resource which does not include any explicit knowledge about any other named resource. [Patrick Stickler ] The URIQA concise bounded description of a resource includes: all statements where the resource is subject Recursively for all statements already found, if there is an anonymous node, include the statements about it, too Recursively for all statements already found, include the CBRD of any reifications.

© 2006 AGDDas semantische Web, SS 2006, , AG Wissensbasierte System, TU KL. 55 AG Wissensbasierte Systeme User Context Observe User behaviour Resources that were accessed Inspired by the Human Mind Model Incoming Perceptions (Actions) Short Term Memory Display of the recent Resources Enables good default values Future use for user support

© 2006 AGDDas semantische Web, SS 2006, , AG Wissensbasierte System, TU KL. 56 AG Wissensbasierte Systeme stack pre - Semantic DesktopSemantic Desktop Application CORBALDAPActiveX http...SQL HTML interface data semantics Relational databases XML.pdf.xls ManualsUML SOAP RDF ontologies Application... text SPARQL RDF/S, OWL

© 2006 AGDDas semantische Web, SS 2006, , AG Wissensbasierte System, TU KL. 57 AG Wissensbasierte Systeme Experimental Projects at TU Kaiserlsautern

© 2006 AGDDas semantische Web, SS 2006, , AG Wissensbasierte System, TU KL. 58 AG Wissensbasierte Systeme Diploma Thesis and Research Projects Diploma Thesis ConTag by Benjamin Horak Semantic Wikis in Knowledge Management by Dominik Heim Cognitive Aspects by Danish Nadeem Semantic Meeting Management by Man Luo Trend Analysis of use Shingo Kubo Research Projects at DFKI EPOS – Evolving Personal to Organizational Knowledge Spaces MyMory Nepomuk EU Project

© 2006 AGDDas semantische Web, SS 2006, , AG Wissensbasierte System, TU KL. 59 AG Wissensbasierte Systeme Literature Bush, V. As We May Think The Atlantic Monthly, 1945, 176(1) Nelson, T. As We Will Think (Xanadu) On-line 72 Conference Proceedings, 1972, vol. 1 Sauermann, L.; Bernardi, A. & Dengel, A. Overview and Outlook on the Semantic Desktop 2005 Leo Sauermann, Gunnar AAstrand Grimnes, Malte Kiesel, Christiaan Fluit, Heiko Maus, Dominik Heim, Danish Nadeem, Benjamin Horak, Andreas Dengel Semantic Desktop 2.0: The Gnowsis Experience 2006

© 2006 AGDDas semantische Web, SS 2006, , AG Wissensbasierte System, TU KL. 60 AG Wissensbasierte Systeme Questions?

Das semantische Web, SS 2008, , AG Wissensbasierte System, TU KL. 61 AG Wissensbasierte Systeme © 2008 AGD d d d jjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjj d asd asfd asdfasfd asdf asfd sadf asfd asdf sadf asdf sda fd dfs sda df da sfd asdf f fad dsfsfd fds d sfd dfs fds mash it up! Leo Sauermann Danke an Jesus, Ingrid Brunner-Sauermann, Heiko Maus, Sven Schwarz, Ansgar Bernardi, Andreas Dengel, Frank Osterfeld, Dominik Heim, Man Luo, Jeen Broekstra, Giovanni Tummarello, Michael Zeltner, Stephan Baumann, Gunnar A Grimnes, Ludger Van Elst, Harald Holz, Stefan Decker, Malte Kiesel, und alle anderen auf #swig paid internships diploma theses open source