Home Reference Source

import {CaseTokenizer} from '@hiherto-elements/natural/src/tokenizers/case-tokenizer.js'

public class | source

CaseTokenizer

Extends:

Tokenizer → CaseTokenizer

Constructor Summary

Public Constructor
public	constructor()

Method Summary

Public Methods
public	attach()
public	tokenize(text: , preserveApostrophe: ): *

Inherited Summary

From class Tokenizer
public	attach()
public	tokenize()
public	trim(array: ):

Public Constructors

public constructor() source

Public Methods

public attach() source

Override:

Tokenizer#attach

public tokenize(text: , preserveApostrophe: ): * source

Override:

Tokenizer#tokenize

Params:

Name	Type	Attribute	Description
text	*
preserveApostrophe	*

Return:

*