hahattpro / crowd_counting_framework (public) (License: Unspecified) (since 2020-12-23) (hash sha1)
backupfrom https://github.com/ttpro1995/crowd_counting_framework
Clone URLs: https://rocketgit.com/user/hahattpro/crowd_counting_framework ssh://rocketgit@ssh.rocketgit.com/user/hahattpro/crowd_counting_framework git://git.rocketgit.com/user/hahattpro/crowd_counting_framework
debug/a-1 develop feature/add_can_adcrowdnet feature/add_context_aware_network feature/attn_can_adcrowd_simple feature/cache_dataloader feature/compact_cnn feature/compare_with_original_count feature/dataloader_not_divide_8 feature/debug_viz feature/documentation feature/improve_density_gen feature/improve_loss_fn feature/loader_full_and_augment feature/refactor-dataflow feature/refactor_ccnn_basecode feature/save_best feature/simple_cometml feature/train_context_aware_network_on_shtA feature/train_dev_test_split hotfix/fix_visualize_data_loader master meow_exp server-training with_apex
List of commits:
Subject Hash Author Date (UTC)
case no label at all 51b423b2ee9271e3639a332ecab092944636d8f2 Thai Thien 2020-09-09 13:49:29
remove experiment 06478164cb8e00ed5512a0d4db0dbc6edc1b5ad1 Thai Thien 2020-09-08 15:10:33
val train test 5a43d57ba16667cb96f9514dcf4b81167ff8bd5a Thai Thien 2020-09-08 15:01:51
parallel, try catch excemption 9ac6a36880a113c1820b1e6a702ed5c08ebcb03f Thai Thien 2020-09-08 14:55:08
now show the number of point in log 54a1a16adf32c866ed65808d16da5f997d27b54f Thai Thien 2020-09-07 17:19:18
gt to ground-truth 3996d1c19d68f3669b5f54e5b621635f0b87a9fc Thai Thien 2020-09-07 17:06:15
change data path 5e6605625ba130310fbeaade259e4a5b98987dad Thai Thien 2020-09-07 17:04:43
test train val e817f1d6f4743286735811fff60f64080a8e76ed Thai Thien 2020-09-07 17:02:57
add profiler fac9aa609d6de1e8cd9cb8a8a97f00063aaae310 Thai Thien 2020-09-07 16:59:36
generate dataset again 7475799e0ff4bdc51ce86ca98751535c841d49c9 Thai Thien 2020-09-07 16:52:00
try to fix cannot convert float infinity to integer b29a994c2f3e73e78ec2ca7d1ad808049f1008e9 Thai Thien 2020-09-07 16:49:44
jhu adamw1_bigtail13i_t1_jhu 77bb789fa2ffadfc07ec6f99e1bcf44bde24bfc3 Thai Thien 2020-09-07 16:38:13
train_dev_test cbfc478aaf7db3accb41a763b0818910999d25a5 Thai Thien 2020-09-06 17:29:37
seem working c44af597b7adf98ecaf3a71e565de8688f7ff6ba Thai Thien 2020-09-06 15:55:28
done single sample cee46d309e9bb91ac4185b0e1b74deddefbc8553 Thai Thien 2020-09-06 15:24:39
a ec2103c6617ad84375e5a7a0f3cde3b32ab012a0 Thai Thien 2020-08-23 15:39:51
pred_count d9168903486d7a88c0763a8e93b18d1ed89d2d40 Thai Thien 2020-08-23 15:37:02
density_map_count = gt_density.detach().sum() 015c7ab3a1734c6002065f775f90870b6c5bdbd5 Thai Thien 2020-08-23 15:35:31
no more eval, only one in function 316b330c481224bb4264ddebb3dda2e317c32ac1 Thai Thien 2020-08-23 15:34:21
None type eval 15a12c6dd1a6f828f5e852faecaf2a812dfddce8 Thai Thien 2020-08-23 15:30:17
Commit 51b423b2ee9271e3639a332ecab092944636d8f2 - case no label at all
Author: Thai Thien
Author date (UTC): 2020-09-09 13:49
Committer name: Thai Thien
Committer date (UTC): 2020-09-09 13:49
Parent(s): 06478164cb8e00ed5512a0d4db0dbc6edc1b5ad1
Signing key:
Tree: b2cd156f20af5f2cf7a5ce7911f690015ccd1fad
File Lines added Lines deleted
dataset_script/jhucrowd_density_map.py 14 7
dataset_script/jhucrowd_train.sh 2 2
dataset_script/jhucrowd_val.sh 2 2
File dataset_script/jhucrowd_density_map.py changed (mode: 100644) (index 2b87023..e8ba00c)
... ... def load_density_label(label_txt_path):
21 21 :param label_txt_path: path to txt :param label_txt_path: path to txt
22 22 :return: numpy array, p[sample, a] with a is 0 for x and 1 for y :return: numpy array, p[sample, a] with a is 0 for x and 1 for y
23 23 """ """
24 df = pd.read_csv(label_txt_path, sep=" ", header=None)
25 p = df.to_numpy()
24 p = None
25 try:
26 df = pd.read_csv(label_txt_path, sep=" ", header=None)
27 p = df.to_numpy()
28 except Exception:
29 print("exception load csv ", label_txt_path)
26 30 return p return p
27 31
28 32
 
... ... def generate_density_map(img_path, label_path, output_path):
82 86
83 87 # empty matrix zero # empty matrix zero
84 88 k = np.zeros((img.shape[0], img.shape[1])) k = np.zeros((img.shape[0], img.shape[1]))
85 for i in range(0, len(gt)):
86 if int(gt[i][1]) < img.shape[0] and int(gt[i][0]) < img.shape[1]:
87 k[int(gt[i][1]), int(gt[i][0])] = 1
88 k = gaussian_filter_density(k)
89 if gt is not None:
90 for i in range(0, len(gt)):
91 if int(gt[i][1]) < img.shape[0] and int(gt[i][0]) < img.shape[1]:
92 k[int(gt[i][1]), int(gt[i][0])] = 1
93 k = gaussian_filter_density(k)
94 # if gt is null, so we don't have count, let it be zero matrix
95
89 96 with h5py.File(output_path, 'w') as hf: with h5py.File(output_path, 'w') as hf:
90 97 hf['density'] = k hf['density'] = k
91 98 return output_path return output_path
 
... ... def full_flow_jhucrowd_parallel(root_path, experiment=None):
172 179 print("exception at ", name) print("exception at ", name)
173 180
174 181
175 Parallel(n_jobs=8)(delayed(jhucrowd_single_file)(img_name) for img_name in img_list)
182 Parallel(n_jobs=20)(delayed(jhucrowd_single_file)(img_name) for img_name in img_list)
176 183
177 184 print("done") print("done")
178 185
File dataset_script/jhucrowd_train.sh changed (mode: 100644) (index 8177f2d..bf08e29)
1 1 HTTPS_PROXY="http://10.60.28.99:86" nohup python dataset_script/jhucrowd_density_map.py \ HTTPS_PROXY="http://10.60.28.99:86" nohup python dataset_script/jhucrowd_density_map.py \
2 2 --task_id jhu_train \ --task_id jhu_train \
3 3 --input /data/rnd/thient/thient_data/jhu_crowd_plusplus/train_data_train_split \ --input /data/rnd/thient/thient_data/jhu_crowd_plusplus/train_data_train_split \
4 > logs/jhucrowd_density_map_train_t3.log &
4 > logs/jhucrowd_density_map_train_t4.log &
5 5
6 echo logs/jhucrowd_density_map_train_t3.log
6 echo logs/jhucrowd_density_map_train_t4.log
File dataset_script/jhucrowd_val.sh changed (mode: 100644) (index de2fa2e..9a80f3d)
1 1 HTTPS_PROXY="http://10.60.28.99:86" nohup python dataset_script/jhucrowd_density_map.py \ HTTPS_PROXY="http://10.60.28.99:86" nohup python dataset_script/jhucrowd_density_map.py \
2 2 --task_id jhu_val \ --task_id jhu_val \
3 3 --input /data/rnd/thient/thient_data/jhu_crowd_plusplus/train_data_validate_split \ --input /data/rnd/thient/thient_data/jhu_crowd_plusplus/train_data_validate_split \
4 > logs/jhucrowd_density_map_val_t3.log &
4 > logs/jhucrowd_density_map_val_t3_to_full.log &
5 5
6 echo logs/jhucrowd_density_map_val_t3.log
6 echo logs/jhucrowd_density_map_val_t3_to_full.log
Hints:
Before first commit, do not forget to setup your git environment:
git config --global user.name "your_name_here"
git config --global user.email "your@email_here"

Clone this repository using HTTP(S):
git clone https://rocketgit.com/user/hahattpro/crowd_counting_framework

Clone this repository using ssh (do not forget to upload a key first):
git clone ssh://rocketgit@ssh.rocketgit.com/user/hahattpro/crowd_counting_framework

Clone this repository using git:
git clone git://git.rocketgit.com/user/hahattpro/crowd_counting_framework

You are allowed to anonymously push to this repository.
This means that your pushed commits will automatically be transformed into a merge request:
... clone the repository ...
... make some changes and some commits ...
git push origin main