Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Imputation manual construction #186

Merged
merged 19 commits into from
May 23, 2024
+624 −18
Merged

Imputation manual construction #186

Changes from 1 commit
Commits
Show all changes
19 commits
Select commit Hold shift + click to select a range
9982a3f
RoM Manual constrction update
vidhyamanisankar May 8, 2024
aecf51c
simple mc scenorio has passed the unit test
vidhyamanisankar May 9, 2024
32be179
fix for black and imputation unittest failures
vidhyamanisankar May 13, 2024
7f3789b
fix for flake8 failure
vidhyamanisankar May 13, 2024
7fe74b3
more MC scenarios unittest data
vidhyamanisankar May 14, 2024
0272232
add methodalogist scenarios 8 to 10 test data
vidhyamanisankar May 15, 2024
bb9bceb
adjust 5th decimal places in test data
vidhyamanisankar May 15, 2024
1df0fc6
remove unnecessary todo
vidhyamanisankar May 15, 2024
62d97d8
wip MC added input data, updated engine file
ZabirAbu May 16, 2024
1ca8b3b
removed unused code
ZabirAbu May 17, 2024
3fcd95c
refactored manual construction chnage
vidhyamanisankar May 17, 2024
6f425c9
add mc back data
vidhyamanisankar May 17, 2024
ed4dda5
refactor for review comment
vidhyamanisankar May 20, 2024
ad30505
throw error if manual_constrution col not df but param set
vidhyamanisankar May 20, 2024
0492053
refactor for review comments
vidhyamanisankar May 21, 2024
faecba3
refactored if contions in imputation engine
vidhyamanisankar May 21, 2024
ab1a97b
refactored mc select colums dynamic based out output_col_mapping
vidhyamanisankar May 22, 2024
6dc4dd2
remove intermediate df
vidhyamanisankar May 23, 2024
14b224f
added unittest for mc_FIMC with link filter
vidhyamanisankar May 23, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Loading
Loading status checks…
adjust 5th decimal places in test data
@vidhyamanisankar
vidhyamanisankar committed May 15, 2024

Verified

This commit was signed with the committer’s verified signature.
vidhyamanisankar vidhyamanisankar
SSH Key Fingerprint: x6RbVGCXdJNcJwvnf7QksFjqBqGmrb5hB3gcWF2IF40
Verified
Learn about vigilant mode
commit bb9bcebd1c9c7b6506bd8ce58eb423464931c8ad
6 changes: 3 additions & 3 deletions ...re_data/imputation/mean_of_ratios/methodology_scenarios/001_78_C_FIC_MC_FIMC_8_output.csv
View file
Original file line number Diff line number Diff line change
@@ -11,7 +11,7 @@ identifier,date,group,growth_forward,growth_backward,forward,backward,constructi
100003,202002,100,0.70683976,17.79512195,1.368771264,11.36048394,171.4175824,3648,R,3,3,3,FALSE,FALSE,FALSE
100003,202003,100,0.056195175,0.079028527,0.4611093,0.266016593,42.61538462,205,R,3,3,3,FALSE,FALSE,FALSE
100003,202004,100,12.65365854,,6.74787815,1,129.032967,2594,R,3,0,3,FALSE,TRUE,FALSE
100004,202001,100,,,1,1.691693133,179.3296703,15422.35165,C,0,3,3,TRUE,FALSE,FALSE
100004,202002,100,,,1.368771264,11.36048394,171.4175824,21109.67176,FIC,3,3,3,FALSE,FALSE,FALSE
100004,202001,100,,,1,1.691693133,179.3296703,15422.351648,C,0,3,3,TRUE,FALSE,FALSE
100004,202002,100,,,1.368771264,11.36048394,171.4175824,21109.671762,FIC,3,3,3,FALSE,FALSE,FALSE
100004,202003,100,,,0.4611093,0.266016593,42.61538462,11085,MC,3,3,3,FALSE,FALSE,FALSE
100004,202004,100,,,6.74787815,1,129.032967,74800.22929,FIMC,3,3,3,FALSE,FALSE,FALSE
100004,202004,100,,,6.74787815,1,129.032967,74800.229291,FIMC,3,0,3,FALSE,TRUE,FALSE
8 changes: 4 additions & 4 deletions .../fixture_data/imputation/mean_of_ratios/methodology_scenarios/001_79_MC_BI_R_9_output.csv
View file
Original file line number Diff line number Diff line change
@@ -1,13 +1,13 @@
identifier,date,group,growth_forward,growth_backward,forward,backward,construction,output,marker,count_forward,count_backward,count_construction,default_forward,default_backward,default_construction
60001,202001,100,,0.648403576,1,7.141605449,117.9107143,5077,R,0,3,3,TRUE,FALSE,FALSE
60001,202002,100,1.54224936,7.485659656,0.785823852,2.619062766,83.74107143,7830,R,3,3,3,FALSE,FALSE,FALSE
60001,202003,100,0.133588761,,7.391291354,1,100.9130435,1046,R,3,0,4,FALSE,TRUE,FALSE
60001,202003,100,0.133588761,,7.391291354,1,100.9130434,1046,R,3,0,4,FALSE,TRUE,FALSE
60002,202001,100,,1.309150866,1,7.141605449,117.9107143,1588,R,0,3,3,TRUE,FALSE,FALSE
60002,202002,100,0.763853904,0.318623588,0.785823852,2.619062766,83.74107143,1213,R,3,3,3,FALSE,FALSE,FALSE
60002,202003,100,3.138499588,,7.391291354,1,100.9130435,3807,R,3,0,4,FALSE,TRUE,FALSE
60002,202003,100,3.138499588,,7.391291354,1,100.9130434,3807,R,3,0,4,FALSE,TRUE,FALSE
60003,202001,100,,19.4672619,1,7.141605449,117.9107143,6541,R,0,3,3,TRUE,FALSE,FALSE
60003,202002,100,0.051368292,0.052905054,0.785823852,2.619062766,83.74107143,336,R,3,3,3,FALSE,FALSE,FALSE
60003,202003,100,18.90178571,,7.391291354,1,100.9130435,6351,R,3,0,4,FALSE,TRUE,FALSE
60003,202003,100,18.90178571,,7.391291354,1,100.9130434,6351,R,3,0,4,FALSE,TRUE,FALSE
60004,202001,100,,,1,7.141605449,117.9107143,839,MC,0,3,3,TRUE,FALSE,FALSE
60004,202002,100,,,0.785823852,2.619062766,83.74107143,1050.244169,BI,3,3,3,FALSE,FALSE,FALSE
60004,202003,100,,,7.391291354,1,100.9130435,401,R,3,0,4,FALSE,TRUE,FALSE
60004,202003,100,,,7.391291354,1,100.9130434,401,R,3,0,4,FALSE,TRUE,FALSE
24 changes: 12 additions & 12 deletions ...ure_data/imputation/mean_of_ratios/methodology_scenarios/001_80_R(MC)_R_FIR_10_output.csv
View file
Original file line number Diff line number Diff line change
@@ -1,13 +1,13 @@
identifier,date,group,growth_forward,growth_backward,forward,backward,construction,output,marker,count_forward,count_backward,count_construction,default_forward,default_backward,default_construction
30001,202001,100,,1.129481006,1,1.655005651,120.1991,8444,R,0,4,4,TRUE,FALSE,FALSE
30001,202002,100,0.885362387,3.732401398,8.743054929,1.866715325,90.8436,7476,R,4,3,4,FALSE,FALSE,FALSE
30001,202003,100,0.267924024,,1.526947,1,103.0154,2003,R,3,0,3,FALSE,TRUE,FALSE
30002,202001,100,,1.195062676,1,1.655006,120.1991,9343,R,0,4,4,TRUE,FALSE,FALSE
30002,202002,100,0.836776196,1.596487645,8.743054929,1.866715325,90.8436,7818,R,4,3,4,FALSE,FALSE,FALSE
30002,202003,100,0.626375032,,1.526947,1,103.0154,4897,R,3,0,3,FALSE,TRUE,FALSE
30003,202001,100,,4.265190233,1,1.655006,120.1991,7511,R,0,4,4,TRUE,FALSE,FALSE
30003,202002,100,0.234456131,0.271256932,8.743054929,1.866715325,90.8436,1761,R,4,3,4,FALSE,FALSE,FALSE
30003,202003,100,3.686541738,,1.526947,1,103.0154,6492,R,3,0,3,FALSE,TRUE,FALSE
30004,202001,100,,0.030288689,1,1.655006,120.1991,64,R,0,4,4,TRUE,FALSE,FALSE
30004,202002,100,33.015625,,8.743054929,1.866715325,90.8436,2113,R,4,3,4,FALSE,FALSE,FALSE
30004,202003,100,,,1.526947,1,103.0154,3226.439011,FIR,3,0,3,FALSE,TRUE,FALSE
30001,202001,100,,1.129481006,1,1.655005651,120.199052,8444,R,0,4,4,TRUE,FALSE,FALSE
30001,202002,100,0.885362387,3.732401398,8.743054929,1.866715325,90.843602,7476,R,4,3,4,FALSE,FALSE,FALSE
30001,202003,100,0.267924024,,1.526947,1,103.015385,2003,R,3,0,3,FALSE,TRUE,FALSE
30002,202001,100,,1.195062676,1,1.655006,120.199052,9343,R,0,4,4,TRUE,FALSE,FALSE
30002,202002,100,0.836776196,1.596487645,8.743054929,1.866715325,90.843602,7818,R,4,3,4,FALSE,FALSE,FALSE
30002,202003,100,0.626375032,,1.526947,1,103.015385,4897,R,3,0,3,FALSE,TRUE,FALSE
30003,202001,100,,4.265190233,1,1.655006,120.199052,7511,R,0,4,4,TRUE,FALSE,FALSE
30003,202002,100,0.234456131,0.271256932,8.743054929,1.866715325,90.843602,1761,R,4,3,4,FALSE,FALSE,FALSE
30003,202003,100,3.686541738,,1.526947,1,103.015385,6492,R,3,0,3,FALSE,TRUE,FALSE
30004,202001,100,,0.030288689,1,1.655006,120.199052,64,R,0,4,4,TRUE,FALSE,FALSE
30004,202002,100,33.015625,,8.743054929,1.866715325,90.843602,2113,R,4,3,4,FALSE,FALSE,FALSE
30004,202003,100,,,1.526946931056,1,103.015385,3226.438865,FIR,3,0,3,FALSE,TRUE,FALSE