Skip to content

Commit

Permalink
fixes
Browse files Browse the repository at this point in the history
  • Loading branch information
@szabgab
szabgab committed Oct 7, 2020
1 parent fc8c27c commit 1e3013b
Show file tree
Hide file tree
Showing 2 changed files with 22 additions and 55 deletions.
52 changes: 14 additions & 38 deletions programming/introduction.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -16,7 +16,7 @@
{i: CPU}

* [Computer Hardware](https://en.wikipedia.org/wiki/Computer#Hardware)
* [CPU - Central Processing Unit](https://en.wikipedia.org/wiki/Central_processing_unit) (Single core, multi-core), (clock speed in GHz), instruction set (386, Pentium, i3, i7, ...)
* [CPU - Central Processing Unit](https://en.wikipedia.org/wiki/Central_processing_unit) (Single core, multi-core), (clock speed in GHz), instruction set (386, Pentium, i3, i7, ...)
* [RAM - Random Access Memory](https://en.wikipedia.org/wiki/Random-access_memory) (in phones a few Gbs, in PCs 4-16 Gb, in servers it can reach a few hundred Gbs as well)
* [Hard disk](https://en.wikipedia.org/wiki/Hard_disk_drive) (spinning disks or [SSD - Solid State Drive](https://en.wikipedia.org/wiki/Solid-state_drive)) - Phone: 16, 32, 64 Gb; Computer a 1-2-3 TBs of spinnig disk or 128,256,512 Gb of SSD. Spinnning disks are slower but much cheaper than SSD.
* [Mother board](https://en.wikipedia.org/wiki/Motherboard)
Expand All @@ -29,8 +29,6 @@
* [BIOS](https://en.wikipedia.org/wiki/BIOS)
* External connectors



## connectors
{id: connectors}

Expand All @@ -46,7 +44,6 @@
* [Thunderbolt](https://en.wikipedia.org/wiki/Thunderbolt_(interface))



## bits and bytes
{id: bits}

Expand All @@ -65,15 +62,15 @@ base 2: 00101010
* [Transistor](https://en.wikipedia.org/wiki/Transistor)



## Y2K problem
{id: y2k-problem}
{i: Y2K}


Y2K problem (time represented as the last two digit of the year.
Instead of 1985 we wrote 85 saved space, looked clear. You also knew that the year 86 was after the year 85 as 8 > 85.

Instead of 1985 we wrote 85 saved space, looked clear. You also knew that the year 86 was after the year 85 becasue 86 > 85.
It worked until 1999, but when 2000 came it was (supposed to be) represented as 00.

Suddenly tomorrow was before yesterday.

[Year 2000 problem](https://en.wikipedia.org/wiki/Year_2000_problem)
Expand All @@ -89,7 +86,7 @@ Suddenly tomorrow was before yesterday.
## Incorrect floating point number representation
{id: floating-point-representation}

[Floating point arithmetic](https://en.wikipedia.org/wiki/Floating-point_arithmetic)
* [Floating point arithmetic](https://en.wikipedia.org/wiki/Floating-point_arithmetic)

e.g. in python:

Expand Down Expand Up @@ -138,6 +135,8 @@ Embedded
## Programming paradigms
{id: programming-paradigms}

* [Programming paradigms](https://en.wikipedia.org/wiki/Programming_paradigm)

* imperative (global state, no functions)
* procedural - imperative (C, Bash)
* object oriented - imperative (Java, C#, C++)
Expand All @@ -147,13 +146,8 @@ Embedded
* mathematical - declerative (Fortran)
* ...



Multi-paradigm: (e.g. Python, Perl)




## Different OOP systems
{id: different-oop-systems}

Expand All @@ -177,8 +171,6 @@ Multi-paradigm: (e.g. Python, Perl)
* Python, Perl, ...?
* Java, C#, ...?



## Open Source
{id: open-source}

Expand All @@ -191,16 +183,11 @@ Multi-paradigm: (e.g. Python, Perl)
* [Open Source Initiative](https://opensource.org/)



## Why create Open Source?
{id: why-create-open-source}



Why do people create and maintain them? Why do companies contribute to Open Source and why do they release under OS license?



* Fun, creative work
* I wrote this thing, but I don't want to sell it so why not?
* Get feedback
Expand All @@ -209,8 +196,6 @@ Why do people create and maintain them? Why do companies contribute to Open Sour
* Undermine competitors




## Open Source languages
{id: language-tooling}

Expand All @@ -221,8 +206,6 @@ Why do people create and maintain them? Why do companies contribute to Open Sour
* Profilers?




## Version Control
{id: version-control}

Expand All @@ -234,7 +217,6 @@ Why do people create and maintain them? Why do companies contribute to Open Sour
* git, mercurial; subversion; cvs; rcs



## Software testing
{id: software-testing}

Expand Down Expand Up @@ -277,27 +259,21 @@ O(n log n)
## What is the Cloud?
{id: what-is-the-cloud}

* Some other peoples computer.
* The computer of some other people.
* Server where you can rent some processing power.
* More sofisticated if you can rent the use of an application.
* Gmail
* Google docs
* Dropbox
* Google Cloud Service, Amazon Web Services (AWS), Microsoft Azure



## Software Development methods
{id: software-development-methods}

* Waterfall
* Agile?
* Scrum
* Kanban
* DevOps
* XP




* [Waterfall](https://en.wikipedia.org/wiki/Waterfall_model)
* [Agile](https://en.wikipedia.org/wiki/Agile_software_development) - [Agile manifesto](https://agilemanifesto.org/)
* [Scrum](https://en.wikipedia.org/wiki/Scrum_(software_development))
* [Kanban](https://en.wikipedia.org/wiki/Kanban)
* [DevOps](https://en.wikipedia.org/wiki/DevOps)
* [XP - eXtremen Programming](https://en.wikipedia.org/wiki/Extreme_programming)

25 changes: 8 additions & 17 deletions python/scipy.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -5,25 +5,27 @@
{id: data-science-tools-in-python}

* [SciPy](https://www.scipy.org/) ecosystem of open-source software for mathematics, science, and engineering.
* [Biopython](https://biopython.org/) tools for biological computation.
* [BioPython](https://biopython.org/) tools for biological computation.
* [NumPy](http://www.numpy.org/) to handle N-dimensional arrays.
* [Pandas](https://pandas.pydata.org/) Python Data Analysis Library. (Data Frames)
* [Matplotlib](http://matplotlib.org/) a 2D plotting library.
* [Seaborn](https://seaborn.pydata.org/) data visualization library based on matplotlib.
* [Bokeh](https://bokeh.pydata.org/) interactive visualization library.
* [SciKit-Learn](http://scikit-learn.org/) Machine Learning in Python. (name from: SciPy Toolkit)
* [TensorFlow](https://www.tensorflow.org/) Machine learning framework. (developed by Google engineer)
* [Keras](https://keras.io/) Python Deep learning (neural-network) library. (On top of Tensorflow.)
* [Orange](https://orange.biolab.si/) machine learning and data visualization tool. Written partially in Python.
* [TensorFlow](https://www.tensorflow.org/) Machine learning framework. (primarily for deep-learning) (developed by Google engineer)
* [Keras](https://keras.io/) Machine learning framework (primarily for deep-learning, neural-network). (On top of Tensorflow and now part of it.)
* [PyTorch](https://pytorch.org/) Machine learnng framework. (primarily for deep-learning) (from Facebook)
* [Orange](https://orange.biolab.si/) Machine learning and data visualization tool. Written partially in Python.

* [Airflow](https://airflow.apache.org/) Workflow management platform (from AirBnB)
* [Luigi](https://github.com/spotify/luigi) Data pipelines (from Spotify)

* [Showing speed improvement using a GPU with CUDA and Python with numpy on Nvidia Quadro 2000D](https://code-maven.com/showing-speed-improvement-with-gpu-cuda-numpy)


* [Octave](https://www.gnu.org/software/octave/) (Open Source Matlab replacement - not related to Python)

* There are a lot more libraries for each one of these tasks. Shop around!


## Data Analysis resources
{id: data-analysis-resources}
Expand All @@ -33,30 +35,19 @@
* [Statistical Signal Extraction and Filtering: Structual Time Series Models](https://www.le.ac.uk/users/dsgp1/ERCSTUFF/ercimstruct.pdf)
* [Panel Data](https://en.wikipedia.org/wiki/Panel_data )


For Econometrics


* [Econometric Analysis](http://pages.stern.nyu.edu/~wgreene/Text/econometricanalysis.htm)
* [Microeconometric Modeling and Discrete Choice Analysis with Cross Section and Panel Data](http://people.stern.nyu.edu/wgreene/Microeconometrics.htm)


For Intro Stats,

For Intro Stats

* [Applied Statistics with R](https://daviddalpiaz.github.io/appliedstats/)
* [Statistics: A Fresh Approach](https://www.amazon.com/Statistics-Approach-Donald-H-Sanders/dp/0070546789)



Datasets


* [Climate](http://www.worldclim.org/)
* [Open Weather map](https://openweathermap.org/bulk)
* [PRB](https://www.prb.org/)





0 comments on commit 1e3013b

Please sign in to comment.