Valer Cara valer-cara

Anti-hype LLM reading list

Goals: Add links that are reasonable and good explanations of how stuff works. No hype and no vendor content if possible. Practical first-hand accounts of models in prod eagerly sought.

Foundational Concepts

Pre-Transformer Models

How to install CUDA / cuDNN / TensorRT on Ubuntu

Install NVIDIA drivers

Update & upgrade

sudo apt update && sudo apt upgrade

Remove previous NVIDIA installation

List of desktop Nvidia GPUS ordered by CUDA core count

Compute Capability from (https://developer.nvidia.com/cuda-gpus) Check the card / architecture / gencode info: (https://arnon.dk/matching-sm-architectures-arch-and-gencode-for-various-nvidia-cards/)

GPU	CUDA cores	Memory	Processor frequency	Compute Capability	CUDA Support
GeForce GTX TITAN Z	5760	12 GB	705 / 876	3.5	until CUDA 11
NVIDIA TITAN Xp	3840	12 GB	1582	6.1	CUDA 8+

Falsehoods that Ethereum programmers believe

I recently stumbled upon Falsehoods programmers believe about time zones, which got a good laugh out of me. It reminded me of other great lists of falsehoods, such as about names or time, and made me look for an equivalent for Ethereum. Having found none, here is my humble contribution to this set.

About Gas

Calling `estimateGas` will return the gas required by my transaction

Calling estimateGas will return the gas that your transaction would require if it were mined now. The current state of the chain may be very different to the state in which your tx will get mined. So when your tx i

Enable profiling

Default http server

import (
    _ "net/http/pprof"
    "net/http"
)

OFFICIAL OPENSOURCE SYSDIG CHEAT SHEET

Basic usage

Capture & write every system event to standard output

About

This gist will show how to setup Raspbian Stretch as a headless Bluetooth A2DP audio sink. This will allow your phone, laptop or other Bluetooth device to play audio wirelessly through a Rasperry Pi.

Motivation

A quick search will turn up a plethora of tutorials on setting up A2DP on the Raspberry Pi. However, I felt this gist was necessary because this solution is:

Automatic & Headless - Once setup, the system is entirely automatic. No user iteration is required to pair, connect or start playback. Therefore the Raspberry Pi can be run headless.
Simple - This solution has few dependencies, readily available packages and minimal configuration.
Up to date - As of December 2017. Written for Raspbian Stretch & Bluez 5.43

	# Upper
	cpulimit -l 1 -- taskset -c 0 ./pct
	cpulimit -l 18 -- taskset -c 1 ./pct
	cpulimit -l 35 -- taskset -c 2 ./pct
	cpulimit -l 52 -- taskset -c 3 ./pct
	cpulimit -l 69 -- taskset -c 4 ./pct
	cpulimit -l 86 -- taskset -c 5 ./pct
	cpulimit -l 103 -- taskset -c 6 ./pct

	cpulimit -l 1 -- taskset -c 63 ./pct

	# you will need to alias the internal kube IPs to your loopback interface

	# get pods with IPs
	kubectl get pods -n kafka -o wide

	# add aliases
	sudo ifconfig lo0 100.101.168.109 alias
	sudo ifconfig lo0 100.117.38.251 alias
	sudo ifconfig lo0 100.121.158.154 alias