You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
A flexible and general-purpose ngrams library written in Ruby. Raingrams supports ngram sizes greater than 1, text/non-text grams, multiple parsing styles and open/closed vocabulary models.
Raingrams is a flexible and general-purpose ngrams library written in Ruby.
Raingrams supports ngram sizes greater than 1, text/non-text grams, multiple
parsing styles and open/closed vocabulary models.
Features
Supports ngram sizes greater than 1.
Supports text and non-text grams.
Supports Open and Closed vocabulary models.
Supports calculating the similarity and commonality of sample text against
specified models.
Supports generating random text from models.
Install
$ sudo gem install raingrams
Examples
Train a model with ycombinator comments:
require 'raingrams'
require 'nokogiri'
require 'open-uri'
include Raingrams
model = BigramModel.build do |model|
doc = Nokogiri::HTML(open('https://news.ycombinator.org/newcomments'))
doc.search('span.comment') do |span|
model.train_with_text(span.inner_text)
end
end
Update a trained model:
model.train_with_text %{Interesting videos. Anders talks about
functional support on .net, concurrency, immutability. Guy Steele
talks about Fortress on JVM. Too bad they are afraid of macros
(access to AST), though Steele does say Fortress has some support.}
model.refresh
Generate a random sentence:
model.random_sentence
# => "OTOOH if you use slicehost even offer to bash Apple makes it will
exit and its 38 month ago based configuration of little networks
created."
Dump a model to a file, to be marshaled later:
model.save('path/for/model')
Load a model from a file:
Model.open('path/for/model')
Copyright
Copyright (c) 2010 Hal Brodigan
See {file:LICENSE.txt} for license information.
About
A flexible and general-purpose ngrams library written in Ruby. Raingrams supports ngram sizes greater than 1, text/non-text grams, multiple parsing styles and open/closed vocabulary models.
