eu.clarin.weblicht.wlfxb.tc.api

Interface TokensLayer

All Superinterfaces:

TextCorpusLayer

All Known Implementing Classes:

TokensLayerStored

public interface TokensLayer
extends TextCorpusLayer

The TokensLayer is composed of token elements, each having a unique identifier and token string value. Optionally, each token can reference its start and end character offset position in relation to the character string in the text layer. The TokensLayer is the main anchor layer among layers of the TextCorpus, i.e. all other layers (with the exception of the text layer) directly or indirectly (via other layers) reference tokens.

Author:

Yana Panchenko and Mohammad Fazleh Elahi

Method Summary

Modifier and Type	Method and Description
Token	addToken(String tokenString)
Token	addToken(String tokenString, long start, long end)
Token	addToken(String tokenString, long start, long end, String tokenId)
Token	addToken(String tokenString, String tokenId)
Token	addTokenWithSurfaceForm(String tokenString, String surfaceForm)
Token	addTokenWithSurfaceForm(String tokenString, String surfaceForm, Long start, Long end)
Token	addTokenWithSurfaceForm(String tokenString, String surfaceForm, Long start, Long end, String tokenId)
Token	addTokenWithSurfaceForm(String tokenString, String surfaceForm, String tokenId)
Token	addTokenWithSurfaceFormParts(String tokenString, String surfaceForm, String[] parts)
Token	addTokenWithSurfaceFormParts(String tokenString, String surfaceForm, String[] parts, Long start, Long end)
Token	addTokenWithSurfaceFormParts(String tokenString, String surfaceForm, String[] parts, Long start, Long end, String tokenId)
Token	addTokenWithSurfaceFormParts(String tokenString, String surfaceForm, String[] parts, String tokenId)
Token	getToken(int index)
Token	getToken(String tokenId)
boolean	hasCharOffsets()

Methods inherited from interface eu.clarin.weblicht.wlfxb.tc.api.TextCorpusLayer

isEmpty, size

Method Detail

getToken

Token getToken(int index)

getToken

Token getToken(String tokenId)

hasCharOffsets

boolean hasCharOffsets()

addToken

Token addToken(String tokenString)

addToken

Token addToken(String tokenString,
               String tokenId)

addToken

Token addToken(String tokenString,
               long start,
               long end)

addToken

Token addToken(String tokenString,
               long start,
               long end,
               String tokenId)

addTokenWithSurfaceForm

Token addTokenWithSurfaceForm(String tokenString,
                              String surfaceForm)

addTokenWithSurfaceForm

Token addTokenWithSurfaceForm(String tokenString,
                              String surfaceForm,
                              String tokenId)

addTokenWithSurfaceForm

Token addTokenWithSurfaceForm(String tokenString,
                              String surfaceForm,
                              Long start,
                              Long end)

addTokenWithSurfaceForm

Token addTokenWithSurfaceForm(String tokenString,
                              String surfaceForm,
                              Long start,
                              Long end,
                              String tokenId)

addTokenWithSurfaceFormParts

Token addTokenWithSurfaceFormParts(String tokenString,
                                   String surfaceForm,
                                   String[] parts)

addTokenWithSurfaceFormParts

Token addTokenWithSurfaceFormParts(String tokenString,
                                   String surfaceForm,
                                   String[] parts,
                                   String tokenId)

addTokenWithSurfaceFormParts

Token addTokenWithSurfaceFormParts(String tokenString,
                                   String surfaceForm,
                                   String[] parts,
                                   Long start,
                                   Long end)

addTokenWithSurfaceFormParts

Token addTokenWithSurfaceFormParts(String tokenString,
                                   String surfaceForm,
                                   String[] parts,
                                   Long start,
                                   Long end,
                                   String tokenId)