Wednesday, July 21, 2021
Tuesday, July 13, 2021
statistical knowledge
1. how to normalize data
2. how to detect outlier, what is IQR?
3. how to reverse a list in python
4. how to insert a number in a list in python
5. how does spark's rdd work? how is it diffrent from pyspark's dataframe?
6. how to calculate cumulative sums in a table in sql
7. what is the difference between mapreduce and in-memory?
8. what is mapreduce?
9. what is lag?
10. proceeding and in sql?
11. how to count number of data points in a numpy array?
12. how to do hyperthesis test?
13. what is false positive rate? what is false negative rate?
14. how to delete duplicates in a dataframe in python?
15. what is false discovery rate? and bonferroni correction?
Monday, July 12, 2021
what is false discovery rate
what is false discovery rate?
https://www.youtube.com/watch?v=3PVkfQRUGI4
an interesting video talking about it.
it is something we predefined in a hyperthesis testing. a type one erro for the multiple testing we tried to control.
a concise video about bonferroni correction
https://www.youtube.com/watch?v=HLzS5wPqWR0
to understand bonferroni correction, first , we need to understand family-wise error rate,
a1=type one error
FWER=1-(1-a1)^m
m is the number of tests
bonferroni correction
corrected a1
=a1/k
k is the number of tests performed.
FWER=1-(1-a1/k)^k
Saturday, July 10, 2021
Thursday, July 1, 2021
Subscribe to:
Posts (Atom)
-
Previously, I wanted to install "script" on Atom to run PHP. And there was some problem, like the firewall. So I tried atom-runner... -
I tried to commit script to bitbucket using sourcetree. I first cloned from bitbucket using SSH, and I got an error, "authentication ... -
How to learn SQL quickly? SQL is an easy database language to pull data from database, and make calculations etc. on it. It has many edit...