leandromoreira /digital_video_introduction
A hands-on introduction to video technology: image, video, codec (av1, vp9, h265) and more (ffmpeg encoding). Translations: ๐บ๐ธ ๐จ๐ณ ๐ฏ๐ต ๐ฎ๐น ๐ฐ๐ท ๐ท๐บ ๐ง๐ท ๐ช๐ธ
โ
16,387โ 1,379๐ 424โ 87โ 56โค 2
More from this author
-2
Daily
+9
Weekly
+30
Monthly
16,387
stars
1,379
forks
424
watchers
87
prs
56
issues
2
releases
README
๐บ๐ธ
๐จ๐ณ
๐ฏ๐ต
๐ฎ๐น
๐ฐ๐ท
๐ท๐บ
๐ง๐ท
๐ช๐ธ
Intro
A gentle introduction to video technology, although it's aimed at software developers / engineers, we want to make it easy for anyone to learn. This idea was born during a mini workshop for newcomers to video technology.
The goal is to introduce some digital video concepts with a simple vocabulary, lots of visual elements and practical examples when possible, and make this knowledge available everywhere. Please, feel free to send corrections, suggestions and improve it.
There will be hands-on sections which require you to have docker installed and this repository cloned.
bash
git clone https://github.com/leandromoreira/digital_video_introduction.git
cd digital_video_introduction
./setup.sh
WARNING: when you see a ./s/ffmpeg or ./s/mediainfo command, it means we're running a containerized version of that program, which already includes all the needed requirements.
All the hands-on should be performed from the folder you cloned this repository. For the jupyter examples you must start the server ./s/start_jupyter.sh and copy the URL and use it in your browser.
Changelog
added DRM system
released version 1.0.0
added simplified Chinese translation
added FFmpeg oscilloscope filter example
added Brazilian Portuguese translation
added Spanish translation
Index
- Intro
- Index
- Basic terminology
Other ways to encode a color image
Hands-on: play around with image and color
DVD is DAR 4:3
Hands-on: Check video properties
- Redundancy removal
Colors, Luminance and our eyes
+ Color model
+ Converting between YCbCr and RGB
+ Chroma subsampling
+ Hands-on: Check YCbCr histogram
Frame types
+ I Frame (intra, keyframe)
+ P Frame (predicted)
- Hands-on: A video with a single I-frame
+ B Frame (bi-predictive)
- Hands-on: Compare videos with B-frame
+ Summary
Temporal redundancy (inter prediction)
- Hands-on: See the motion vectors
Spatial redundancy (intra prediction)
- Hands-on: Check intra predictions
- How does a video codec work?
What? Why? How?
History
+ The birth of AV1
A generic codec
1st step - picture partitioning
+ Hands-on: Check partitions
2nd step - predictions
3rd step - transform
+ Hands-on: throwing away different coefficients
4th step - quantization
+ Hands-on: quantization
5th step - entropy coding
+ VLC coding
+ Arithmetic coding
+ Hands-on: CABAC vs CAVLC
6th step - bitstream format
+ H.264 bitstream
+ Hands-on: Inspect the H.264 bitstream
Review
How does H.265 achieve a better compression ratio than H.264?
- Online streaming
General architecture
Progressive download and adaptive streaming
Content protection
- How to use jupyter
- Conferences
- References
Basic terminology
An image can be thought of as a 2D matrix. If we think about colors, we can extrapolate this idea seeing this image as a 3D matrix where the additional dimensions aTop issues
#93File size - YCbCr 422 vs YCbCr 42011 comments ยท 2020-04-28#57Docker Req'd?7 comments ยท 2017-10-10#137Question regarding "2nd Step - predictions"4 comments ยท 2023-08-17#83On the front page, I do not understand explanation of 4:2:2 etc4 comments ยท 2019-06-25#71Doubts on function of cones and rods3 comments ยท 2018-08-08#35What does this sentence mean?Thanks2 comments ยท 2017-06-11#29Add info about BT.709 recommendation2 comments ยท 2017-06-06#22Minor2 comments ยท 2017-06-03