Bookmarks: Difference between revisions
Jump to navigation
Jump to search
(→AI) |
|||
Line 13: | Line 13: | ||
* [https://www.youtube.com/watch?v=tCPzYM7B338 Guppies, an evolving neural network]. |
* [https://www.youtube.com/watch?v=tCPzYM7B338 Guppies, an evolving neural network]. |
||
* [https://blog.insightdatascience.com/the-unreasonable-effectiveness-of-deep-learning-representations-4ce83fc663cf The Unreasonable Effectiveness of Deep Learning Representations]. |
* [https://blog.insightdatascience.com/the-unreasonable-effectiveness-of-deep-learning-representations-4ce83fc663cf The Unreasonable Effectiveness of Deep Learning Representations]. |
||
* [https://medium.com/@NPCollapse/gpt2-counting-consciousness-and-the-curious-hacker-323c6639a3a8 GPT2, Counting Consciousness and the Curious Hacker] |
|||
:Student's post about replicating OpenAI's GPT2 1.5B dataset, and is about to release it, and long explanation why. GPT2 generates very interesting [https://openai.com/blog/better-language-models/#sample1 samples]. Humanity success is more because of collaboration / trust, than intelligence, and our ability has human to identify trustable information. If we have a system charged with detecting what we can and can’t trust, we aren’t removing our need to invest trust, we are only moving our trust from our own faculties to those of the machine. |
|||
== Mathemathics == |
== Mathemathics == |
Revision as of 18:46, 8 June 2019
- Funny, interesting — https://www.vidarholen.net/contents/wordcount/
- Show how many times frustrated Linux kernel developers have put four letter words into the source code.
- http://www.fillmurray.com/ — Fill Murray
- An online tool to provide custom-sized placeholder images of Bill Murray!
http://fillmurray.com/200/300
. - I like the humor and layout of the page. Images are superb.
- Check also PlaceCage (Nick Cage Filler Images) and Steven SeGALLERY (Steven Segal Filler Images) :-D
- An amazing video from A Capella Science on biology science. Amazing song. More to see on the YouTube channel.
AI
- Guppies, an evolving neural network.
- The Unreasonable Effectiveness of Deep Learning Representations.
- GPT2, Counting Consciousness and the Curious Hacker
- Student's post about replicating OpenAI's GPT2 1.5B dataset, and is about to release it, and long explanation why. GPT2 generates very interesting samples. Humanity success is more because of collaboration / trust, than intelligence, and our ability has human to identify trustable information. If we have a system charged with detecting what we can and can’t trust, we aren’t removing our need to invest trust, we are only moving our trust from our own faculties to those of the machine.
Mathemathics
- Correlation is not causation.
- Tangente n°182, p34-35, "Les excès de la corrélation".
- Nous allons vers un changement épistémologique majeur. S'en remettre à ce type de calcul traduit un renoncement aux ambitions de la raison moderne, qui liait les phénomènes à leurs causes. Ces ambitions de la raison permettaient d'envisager la prévention, d'agir sur les causes pour changes les effets. Au lieu de cela, on se dirige vers un système de pures corrélations. [...] On ne cherche plus à comprendre l'environnement, on cherche à le prédire. Notre rapport au savoir change, mais aussi notre rapport au monde: on se focalise davantage qu'auparavant sur les risques. "Voir et comprendre" sont supplantés par détecter et prévenir". On passe d'une civilisation du signe, qui était porteur de sens, à une civilisation du signal, qui est une donnée qui ne signifie rien en soi..
- How to cut fairly a cake in three (and more) pieces.
- The evolution of trust — a fun lecture for understanding game theory in a broader context.
Tools
- oclif, an open source framework for building a command line interface (CLI) in Node.js.
- Mosh, a mobile SSH client.
- Live Chat online typing test
- Warp, create self-contained single binary applications.
- Goosh.org, an unofficial Google shell.
Apps
- Krita 4.0 released, Krita is a professional FREE and open source painting program.
- Draw.io — a free alternative to Visio, very powerful and that integrates nicely in many online platforms (GitLab...). Available offline, and as stand-alone executable as well.
Books
- Seven Sketches in Compositionality: An Invitation to Applied Category Theory
- Principles of Algorithmic Problem Solving, by Johan Sannemo, 2017.
- A book on algorithmic problem solving, the art of formulating efficient methods that solve problems of a mathematical nature.
- Online digital book on typography from Matthew Butterick, including tips to learn typography in ten minutes.
Dev
- POSE - Declarative motion system for HTML, SVG & React
- Debugging across pipes and sockets with strace
- Crystal-clear tutorial on how to use
strace
,lsof
andgdb
to debug inter-process issues on Linux.
- open source Python graphing library, with Javascript interaction.
- HyperPolyglot, showing common-used features side-by-side.
- The microarchitecture of Intel, AMD and VIA CPUs
- An optimization guide for assembly programmers and compiler makers By Agner Fog. Technical University of Denmar.
- Nine reasons why Lisp and Racket are good programming languages. From Matthew Butterick, author of the book Practical Typography and of Pollen, a digital book publishing system.
Rust
- Many interesting comments on RUST, and how to write / debug programs with concurrency/performance in mind.
Methodology
- 5 reasons not to rewrite an existing code.
- About the mistake of full rewrite (Netscape 6, Borland Quattro Pro). Instead refactor, rename,
- Instead of rewriting, write a strangler application, that will progressively replace the old system.
- Tesler's Law, also known as The Law of Conservation of Complexity, states that for any system there is a certain amount of complexity which cannot be reduced.
- About Semantic Versioning and tips / pits to introduce new functionality, and fixing security bugs.
- Don't build technology unless you feel the pain of not having it. Then: First make it possible. Then make it beautiful. Then make it fast. Use cases are everything in suffering-oriented programming.
Learn
- All participants spent most of their time studying examples, rather than reading the language documentation.
- Illustrate the Shlemiel the painter’s algorithm when concatenating C strings where performance is n^2 because of the lack of efficient
strlen()
operator.
Web
- Delay non-critical task to idle thread, while forcing their execution if some user event depend on that task being executed first.
Network
- Every byte of a TLS connection explained and reproduced.
Game
- Detailed explanation on how to make a fast tile-based game engine. Tricks used:
- Use LEA instruction, most efficient to move bytes, but requiring modifying the stack pointer.
- Pre-process the tiles to cancel effect of fast rendering loop
- Reverse display order to cancel graphical corruption when interrupt occurs and load registers on the stack.
- Detailed explanation on 2D game optimization for a Super-Mario-like game. Various tricks are explained about fast scrolling, fast sprite handling...
- Background is generated by a LEA-field, basically a sequence of code generated by the game engine, and when executed, draw pixel to the screen buffer. The LEA-field is organized into sequence of code, each drawing a given scanline.
- Scrolling is obtained by a different offset in the scanline.
- When scrolling, the code in leftmost/rightmost columns of the LEA-field must be updated. This update is done by a code, which is also generated by the engine. This column-update code is generated to avoid duplicate register loading (typ. occurs when the scene has many duplicated pixels, like a blue sky).
- Sprite is also generated by a code, generated from sprite data.
- A very fast tile engine for the Apple IIGS, using advanced techniques to achieve 1 pixels every 1.25 cycles.
CVS
- Explain how to obtain perfect patch using digle (directed graph file) instead of files, as used in
pijul
, with some mathematical background.
Languages
- A Scheme/Lisp language.
Design
- Contrast — Elements of your design (colour, size, weight, style) should be either exactly the same, or significantly different.
- Consistency — Make sure similar elements appear in similar ways.
- Occam's Razors (aka Reduce Visual Noise) — The fewer the number of elements you use in your design, the better.
- Space — The way things are positioned sends a meta-level message about their meaning. This deals with proximity (= relatedness), with negative space, and with importance and order.
Science & Tech
- The most complete and detailed description on how our eyes perceive colors.
- Just wow.
Success stories
- With good tips about launching new business online.
- How We Wrote a Textbook, from Tim Wheeler.
- The success story on how a grad student and his professor worked together to write a 500p text book, and the tools and methodology they used.
Miscellaneous
- A detailed explanation about color harmony, what makes some painting rich in colors...
- NERD fonts (github).
- A repository of fonts patched with lots of glyphs (icons). Include patches for Fantasque Sans Mono, Iosevka...
- ... animated for the internet.
- Beautiful animated pages explaining how various things work, like sewing machine, engines, human eye, lcd screen...
Talks
- Talk from Joe Armstrong, co-author of Erlang language, about the complexity of SW and how to fix it.