moerstw moerstw

From theme: Programming

Probabilistic Data Structures for Web Analytics and Data Mining : A great overview of the space of probabilistic data structures and how they are used in approximation algorithm implementation.
Models and Issues in Data Stream Systems
Philippe Flajolet’s contribution to streaming algorithms : A presentation by Jérémie Lumbroso that visits some of the hostorical perspectives and how it all began with Flajolet
Approximate Frequency Counts over Data Streams by Gurmeet Singh Manku & Rajeev Motwani : One of the early papers on the subject.
[Methods for Finding Frequent Items in Data Streams](http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.187.9800&rep

	// Disable bold.
	term_.prefs_.set('enable-bold', false)

	// Use this for Solarized Dark
	term_.prefs_.set('background-color', "#002b36");
	term_.prefs_.set('foreground-color', "#839496");

	term_.prefs_.set('color-palette-overrides', [
	'#073642',
	'#dc322f',

	// load error messages from a log into memory
	// then interactively search for various patterns

	// base RDD
	val lines = sc.textFile("log.txt")

	// transformed RDDs
	val errors = lines.filter(_.startsWith("ERROR"))
	val messages = errors.map(_.split("\t")).map(r => r(1))
	messages.cache()

	$ ./bin/spark-shell
	14/04/18 15:23:49 INFO spark.HttpServer: Starting HTTP Server
	14/04/18 15:23:49 INFO server.Server: jetty-7.x.y-SNAPSHOT
	14/04/18 15:23:49 INFO server.AbstractConnector: Started [email protected]:49861
	Welcome to
	____ __
	/ __/__ ___ _____/ /__
	_\ \/ _ \/ _ `/ __/ '_/
	/___/ .__/\_,_/_/ /_/\_\ version 0.9.1
	/_/

	PkMn BaseStamina BaseAttack BaseDefense Type1 Type2 BaseCaptureRate BaseFleeRate CollisionRadiusM CollisionHeightM CollisionHeadRadiusM MovementType MovementTimerS JumpTimeS AttackTimerS QuickMoves CinematicMoves AnimTime Evolution EvolutionPips PokemonClass PokedexHeightM PokedexWeightKg HeightStdDev WeightStdDev FamilyId CandyToEvolve
	1 90 126 126 HoloPokemonType.POKEMON_TYPE_GRASS HoloPokemonType.POKEMON_TYPE_POISON 0.1599999964237213 0.10000000149011612 0.3815000057220459 0.6539999842643738 0.27250000834465027 HoloPokemonMovementType.POKEMON_ENC_MOVEMENT_JUMP 10.0 1.149999976158142 29.0 d601dd01 5a3b76 6d56d53fdaac2a3f6d56d53f93a9ea3f0000000036ab0a403333b33fbfbbbb3f 02 HoloPokemonClass.POKEMON_CLASS_NORMAL 1 0.699999988079071 6.900000095367432 0.08749999850988388 0.862500011920929 HoloPokemonFamilyId.V0001_FAMILY_BULBASAUR 25
	2 120 156 158 HoloPokemonType.POKEMON_TYPE_GRASS HoloPokemonType.POKEMON_TYPE_POISON 0.07999999821186066 0.07000000029802322 0.3187499940395355 0.637499988079071 0.2549999952316284 H