Semantic network

A semantic network, or frame network is a knowledge base that represents semantic relations between concepts in a network. This is often used as a form of knowledge representation. It is a directed or undirected graph consisting of vertices, which represent concepts, and edges, which represent semantic relations between concepts,[1] mapping or connecting semantic fields.

Network science
Network types
Graphs
Features
Types
Models
Topology
Dynamics
  • Lists
  • Categories
  • Category:Network theory
  • Category:Graph theory

Typical standardized semantic networks are expressed as semantic triples.

Semantic networks are used in natural language processing applications such as semantic parsing[2] and word-sense disambiguation.[3]

History
Example of a semantic network

Examples of the use of semantic networks in logic, directed acyclic graphs as a mnemonic tool, dates back centuries. The earliest documented use being the Greek philosopher Porphyry's commentary on Aristotle’s categories in the third century AD.

In computing history, "Semantic Nets" for the propositional calculus were first implemented for computers by Richard H. Richens of the Cambridge Language Research Unit in 1956 as an "interlingua" for machine translation of natural languages.[4] Although the importance of this work and the CLRU was only belatedly realized.

Semantic networks were also independently implemented by Robert F. Simmons [5] and Sheldon Klein, using the first order predicate calculus as a base, after being inspired by a demonstration of Victor Yngve. The "line of research was originated by the first President of the Association [Association for Computational Linguistics], Victor Yngve, who in 1960 had published descriptions of algorithms for using a phrase structure grammar to generate syntactically well-formed nonsense sentences. Sheldon Klein and I about 1962-1964 were fascinated by the technique and generalized it to a method for controlling the sense of what was generated by respecting the semantic dependencies of words as they occurred in text."[6] Other researchers, most notably M. Ross Quillian[7] and others at System Development Corporation helped contribute to their work in the early 1960s as part of the SYNTHEX project. It's from these publications at SDC that most modern derivatives of the term "semantic network" cite as their background. Later prominent works were done by Allan M. Collins and Quillian (e.g., Collins and Quillian;[8][9] Collins and Loftus[10] Quillian[11][12][13][14]). Still later in 2006, Hermann Helbig fully described MultiNet.[15]

In the late 1980s, two Netherlands universities, Groningen and Twente, jointly began a project called Knowledge Graphs, which are semantic networks but with the added constraint that edges are restricted to be from a limited set of possible relations, to facilitate algebras on the graph.[16] In the subsequent decades, the distinction between semantic networks and knowledge graphs was blurred.[17][18] In 2012, Google gave their knowledge graph the name Knowledge Graph.

The Semantic Link Network was systematically studied as a social semantics networking method. Its basic model consists of semantic nodes, semantic links between nodes, and a semantic space that defines the semantics of nodes and links and reasoning rules on semantic links. The systematic theory and model was published in 2004.[19] This research direction can trace to the definition of inheritance rules for efficient model retrieval in 1998[20] and the Active Document Framework ADF.[21] Since 2003, research has developed toward social semantic networking.[22] This work is a systematic innovation at the age of the World Wide Web and global social networking rather than an application or simple extension of the Semantic Net (Network). Its purpose and scope are different from that of the Semantic Net (or network).[23] The rules for reasoning and evolution and automatic discovery of implicit links play an important role in the Semantic Link Network.[24][25] Recently it has been developed to support Cyber-Physical-Social Intelligence.[26] It was used for creating a general summarization method.[27] The self-organised Semantic Link Network was integrated with a multi-dimensional category space to form a semantic space to support advanced applications with multi-dimensional abstractions and self-organised semantic links [28][29] It has been verified that Semantic Link Network play an important role in understanding and representation through text summarisation applications. [30] [31] To investigate special social semantics, competition relation and symbiosis relation as well as their roles in evolving society were studied in the emerging topic: Cyber-Physical-Social Intelligence [32]

More specialized forms of semantic networks has been created for specific use. For example, in 2008, Fawsy Bendeck's PhD thesis formalized the Semantic Similarity Network (SSN) that contains specialized relationships and propagation algorithms to simplify the semantic similarity representation and calculations.[33]

Basics of semantic networks

A semantic network is used when one has knowledge that is best understood as a set of concepts that are related to one another.

Most semantic networks are cognitively based. They also consist of arcs and nodes which can be organized into a taxonomic hierarchy. Semantic networks contributed ideas of spreading activation, inheritance, and nodes as proto-objects.

Examples

Semantic Net in Lisp

Using an association list.

(setq *database*
'((canary  (is-a bird)
           (color yellow)
           (size small))
  (penguin (is-a bird)
           (movement swim))
  (bird    (is-a vertebrate)
           (has-part wings)
           (reproduction egg-laying))))

You would use the "assoc" function with a key of "canary" to extract all the information about the "canary" type.[34]

WordNet
Main article: WordNet

An example of a semantic network is WordNet, a lexical database of English. It groups English words into sets of synonyms called synsets, provides short, general definitions, and records the various semantic relations between these synonym sets. Some of the most common semantic relations defined are meronymy (A is a meronym of B if A is part of B), holonymy (B is a holonym of A if B contains A), hyponymy (or troponymy) (A is subordinate of B; A is kind of B), hypernymy (A is superordinate of B), synonymy (A denotes the same as B) and antonymy (A denotes the opposite of B).

WordNet properties have been studied from a network theory perspective and compared to other semantic networks created from Roget's Thesaurus and word association tasks. From this perspective the three of them are a small world structure.[35]

Other examples

It is also possible to represent logical descriptions using semantic networks such as the existential graphs of Charles Sanders Peirce or the related conceptual graphs of John F. Sowa.[1] These have expressive power equal to or exceeding standard first-order predicate logic. Unlike WordNet or other lexical or browsing networks, semantic networks using these representations can be used for reliable automated logical deduction. Some automated reasoners exploit the graph-theoretic features of the networks during processing.

Other examples of semantic networks are Gellish models. Gellish English with its Gellish English dictionary, is a formal language that is defined as a network of relations between concepts and names of concepts. Gellish English is a formal subset of natural English, just as Gellish Dutch is a formal subset of Dutch, whereas multiple languages share the same concepts. Other Gellish networks consist of knowledge models and information models that are expressed in the Gellish language. A Gellish network is a network of (binary) relations between things. Each relation in the network is an expression of a fact that is classified by a relation type. Each relation type itself is a concept that is defined in the Gellish language dictionary. Each related thing is either a concept or an individual thing that is classified by a concept. The definitions of concepts are created in the form of definition models (definition networks) that together form a Gellish Dictionary. A Gellish network can be documented in a Gellish database and is computer interpretable.

SciCrunch is a collaboratively edited knowledge base for scientific resources. It provides unambiguous identifiers (Research Resource IDentifiers or RRIDs) for software, lab tools etc. and it also provides options to create links between RRIDs and from communities.

Another example of semantic networks, based on category theory, is ologs. Here each type is an object, representing a set of things, and each arrow is a morphism, representing a function. Commutative diagrams also are prescribed to constrain the semantics.

In the social sciences people sometimes use the term semantic network to refer to co-occurrence networks.[36] The basic idea is that words that co-occur in a unit of text, e.g. a sentence, are semantically related to one another. Ties based on co-occurrence can then be used to construct semantic networks.

Software tools

There are also elaborate types of semantic networks connected with corresponding sets of software tools used for lexical knowledge engineering, like the Semantic Network Processing System (SNePS) of Stuart C. Shapiro[37] or the MultiNet paradigm of Hermann Helbig,[38] especially suited for the semantic representation of natural language expressions and used in several NLP applications.

Semantic networks are used in specialized information retrieval tasks, such as plagiarism detection. They provide information on hierarchical relations in order to employ semantic compression to reduce language diversity and enable the system to match word meanings, independently from sets of words used.

The Knowledge Graph proposed by Google in 2012 is actually an application of semantic network in search engine.

Modeling multi-relational data like semantic networks in low-dimensional spaces through forms of embedding has benefits in expressing entity relationships as well as extracting relations from mediums like text. There are many approaches to learning these embeddings, notably using Bayesian clustering frameworks or energy-based frameworks, and more recently, TransE[39] (NIPS 2013). Applications of embedding knowledge base data include Social network analysis and Relationship extraction.

See also

Other examples

References
  1. John F. Sowa (1987). "Semantic Networks". In Stuart C Shapiro (ed.). Encyclopedia of Artificial Intelligence. Retrieved 29 April 2008.
  2. Poon, Hoifung, and Pedro Domingos. "Unsupervised semantic parsing." Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing: Volume 1-Volume 1. Association for Computational Linguistics, 2009.
  3. Sussna, Michael. "Word sense disambiguation for free-text indexing using a massive semantic network." Proceedings of the second international conference on Information and knowledge management. ACM, 1993.
  4. Lehmann, Fritz; Rodin, Ervin Y., eds. (1992). Semantic networks in artificial intelligence. International series in modern applied mathematics and computer science. 24. Oxford; New York: Pergamon Press. p. 6. ISBN 978-0080420127. OCLC 26391254. The first semantic network for computers was Nude, created by R. H. Richens of the Cambridge Language Research Unit in 1956 as an interlingua for machine translation of natural languages.
  5. Robert F. Simmons (1963). "Synthetic language behavior". Data Processing Management. 5 (12): 11–18.
  6. Simmons, "Themes From 1972", ACL Anthology, 1982
  7. Quillian, R. A notation for representing conceptual information: An application to semantics and mechanical English para- phrasing. SP-1395, System Development Corporation, Santa Monica, 1963.
  8. Allan M. Collins; M. R. Quillian (1969). "Retrieval time from semantic memory". Journal of Verbal Learning and Verbal Behavior. 8 (2): 240–247. doi:10.1016/S0022-5371(69)80069-1.
  9. Allan M. Collins; M. Ross Quillian (1970). "Does category size affect categorization time?". Journal of Verbal Learning and Verbal Behavior. 9 (4): 432–438. doi:10.1016/S0022-5371(70)80084-6.
  10. Allan M. Collins; Elizabeth F. Loftus (1975). "A spreading-activation theory of semantic processing". Psychological Review. 82 (6): 407–428. doi:10.1037/0033-295x.82.6.407.
  11. Quillian, M. R. (1967). Word concepts: A theory and simulation of some basic semantic capabilities. Behavioral Science, 12(5), 410-430.
  12. Quillian, M. R. (1968). Semantic memory. Semantic information processing, 227–270.
  13. Quillian, M. R. (1969). "The teachable language comprehender: a simulation program and theory of language". Communications of the ACM. 12 (8): 459–476. doi:10.1145/363196.363214.
  14. Quillian, R. Semantic Memory. Unpublished doctoral dissertation, Carnegie Institute of Technology, 1966.
  15. Helbig, H. (2006). Knowledge Representation and the Semantics of Natural Language (PDF). ISBN 978-3540244615.
  16. Van de Riet, R. P. (1992). Linguistic Instruments in Knowledge Engineering (PDF). Elsevier Science Publishers. p. 98. ISBN 978-0444883940.
  17. Hulpus, Ioana; Prangnawarat, Narumol (2015). "Path-Based Semantic Relatedness on Linked Data and Its Use to Word and Entity Disambiguation". The Semantic Web – ISWC 2015: 14th International Semantic Web Conference, Bethlehem, PA, USA, October 11–15, 2015, Proceedings, Part 1. International Semantic Web Conference 2015. Springer International Publishing. p. 444.
  18. McCusker, James P.; Chastain, Katherine (April 2016). "What is a Knowledge Graph?". authorea.com. Retrieved 15 June 2016. usage [of the term 'knowledge graph'] has evolved
  19. H. Zhuge, Knowledge Grid, World Scientific Publishing Co. 2004.
  20. H. Zhuge, Inheritance rules for flexible model retrieval. Decision Support Systems 22(4)(1998)379–390
  21. H. Zhuge, Active e-document framework ADF: model and tool. Information & Management 41(1): 87–97 (2003)
  22. H.Zhuge and L.Zheng, Ranking Semantic-linked Network, WWW 2003
  23. H.Zhuge, The Semantic Link Network, in The Knowledge Grid: Toward Cyber-Physical Society, World Scientific Publishing Co. 2012.
  24. H. Zhuge, L. Zheng, N. Zhang and X. Li, An automatic semantic relationships discovery approach. WWW 2004: 278–279.
  25. H. Zhuge, Communities and Emerging Semantics in Semantic Link Network: Discovery and Learning, IEEE Transactions on Knowledge and Data Engineering, 21(6)(2009)785–799.
  26. H.Zhuge, Semantic linking through spaces for cyber-physical-socio intelligence: A methodology, Artificial Intelligence, 175(2011)988–1019.
  27. H. Zhuge, Multi-Dimensional Summarization in Cyber-Physical Society, Morgan Kaufmann, 2016.
  28. H. Zhuge, The Web Resource Space Model, Springer, 2008.
  29. H.Zhuge and Y.Xing, Probabilistic Resource Space Model for Managing Resources in Cyber-Physical Society, IEEE Transactions on Service Computing, 5(3)(2012)404–421.
  30. X. Sun and H. Zhuge, Summarization of Scientific Paper through Reinforcement Ranking on Semantic Link Network, IEEE ACCESS, 2018, doi:10.1109/ACCESS.2018.2856530.
  31. M.Cao, X.Sun and H. Zhuge, The contribution of cause-effect link to representing the core of scientific paper—The role of Semantic Link Network, PLOS ONE, 2018, doi:10.1371/journal.pone.0199303.
  32. H. Zhuge, Cyber-Physical-Social Intelligence on Human-Machine-Nature Symbiosis, Springer, 2020.
  33. Bendeck, Fawsy (2008). WSM-P workflow semantic matching platform. München: Verl. Dr. Hut. ISBN 9783899638547. OCLC 501314022.
  34. Swigger, Kathleen. "Semantic.ppt". Retrieved 23 March 2011.
  35. Steyvers, M.; Tenenbaum, J.B. (2005). "The Large-Scale Structure of Semantic Networks: Statistical Analyses and a Model of Semantic Growth". Cognitive Science. 29 (1): 41–78. arXiv:cond-mat/0110012. doi:10.1207/s15516709cog2901_3. PMID 21702767.
  36. Wouter Van Atteveldt (2008). Semantic Network Analysis: Techniques for Extracting, Representing, and Querying Media Content. BookSurge Publishing.
  37. Stuart C. Shapiro
  38. Hermann Helbig
  39. Bordes, Antoine; Usunier, Nicolas; Garcia-Duran, Alberto; Weston, Jason; Yakhnenko, Oksana (2013), Burges, C. J. C.; Bottou, L.; Welling, M.; Ghahramani, Z. (eds.), "Translating Embeddings for Modeling Multi-relational Data" (PDF), Advances in Neural Information Processing Systems 26, Curran Associates, Inc., pp. 2787–2795, retrieved 29 November 2018

Further reading

This article is issued from Wikipedia. The text is licensed under Creative Commons - Attribution - Sharealike. Additional terms may apply for the media files.