RocketGit

hahattpro / crowd_counting_framework (public) (License: Unspecified) (since 2020-12-23) (hash sha1)

backupfrom https://github.com/ttpro1995/crowd_counting_framework

Clone URLs: https://rocketgit.com/user/hahattpro/crowd_counting_framework ssh://rocketgit@ssh.rocketgit.com/user/hahattpro/crowd_counting_framework git://git.rocketgit.com/user/hahattpro/crowd_counting_framework

List of commits:

Subject	Hash	Author	Date (UTC)
ccnn_v4_t1	1f950b91f4fb89a0f08baf08dffb2a501546b64f	Thai Thien	2020-03-13 16:23:39
add proxy	9afb66a73e3ae24b2144faf311b128dbe5768f3c	Thai Thien	2020-03-13 16:09:30
add comet, add scheduler to simple	4ef5939124745dfc54ad8a87936954a2bde8a5a2	Thai Thien	2020-03-13 16:06:24
ccnn v1_t5 lr scheduler	31f7a693eff8e60a07bd7bc439575cc7712fe31b	Thai Thien	2020-03-13 15:37:37
ccnn_v1_t4_scheduler, also change lr milestones	c27beba80ebf7686dc7f046b95d5e2739b6dae66	Thai Thien	2020-03-12 16:23:02
add load_data_shanghaitech_keepfull_and_crop	5af55c5b483263683db80bcf4b870bfbb241d668	Thai Thien	2020-03-12 16:19:19
change on how it log epoch	adcb2aa917f02d4b5d567a9b70f08ec519f896d1	Thai Thien	2020-03-11 17:32:35
fix the milestone	4e8c048ff8db59cbedc819e4df2a48094568fc2c	Thai Thien	2020-03-11 17:10:03
add COMET_ML_API	7fbec715d751544bcdafb34a686602839a2696de	Thai Thien	2020-03-11 17:04:19
fix script name	631c37c068377706ae2cad4513baeea7e62ae0b5	Thai Thien	2020-03-11 16:59:24
intergrate comet ml into compact cnn	058e90a617acb76a7788e6a5d44f52563342490b	Thai Thien	2020-03-11 16:57:17
something ?!	fff52ff87af2a90452384a01bd6d6e6c4b91654e	Thai Thien	2020-03-11 15:55:04
DilatedCCNNv2	75d2989232a8a68eba9b4920ab2374ac28438e0e	Thai Thien	2020-03-10 05:11:12
fix script for ccnn_v2_t1_c2	57928056d13bc9b1f9b11e14dd305005a3a5aeea	Thai Thien	2020-03-10 04:56:33
fix trash code	33c406b13b5d45527b05dfb7f4281c3966c6471e	Thai Thien	2020-03-10 04:49:52
repair dir in config	baf522825f906a3d1fc5524f42a80da33d059640	Thai Thien	2020-03-10 04:45:11
v3 t1 c2	2d4727f47f4262833dca2087fb9e48f0d117e334	Thai Thien	2020-03-10 04:29:23
dilated ccnn v1 t1	7807d7a979353fa84d0b7319820386e93dbe5cc4	Thai Thien	2020-03-09 17:20:58
new ccnn	44a669c1f918be9d74313f29a5dbbc876c29f2fc	Thai Thien	2020-03-09 17:16:49
fix script	aa331331b12e5b454d372a550524b30a4bebe706	Thai Thien	2020-03-07 18:32:06

Commit 1f950b91f4fb89a0f08baf08dffb2a501546b64f - ccnn_v4_t1
Author: Thai Thien
Author date (UTC): 2020-03-13 16:23
Committer name: Thai Thien
Committer date (UTC): 2020-03-13 16:23
Parent(s): 9afb66a73e3ae24b2144faf311b128dbe5768f3c
Signing key:
Tree: 9fae78a244d9276ba1fdbf97dd865eb25aca78a1

File	Lines added	Lines deleted
args_util.py	1	0
train_compact_cnn.py	18	2
train_script/CCNN/ccnn_v4_t1.sh	8	0

File args_util.py changed (mode: 100644) (index 25625bd..b4c50b3)
...	...	def context_aware_network_args_parse():
82	82	def my_args_parse():	def my_args_parse():
83	83	parser = argparse.ArgumentParser(description='CrowdCounting Context Aware Network')	parser = argparse.ArgumentParser(description='CrowdCounting Context Aware Network')
84	84	parser.add_argument("--task_id", action="store", default="dev")	parser.add_argument("--task_id", action="store", default="dev")
	85		parser.add_argument('--note', action="store", default="write anything")
85	86
86	87	parser.add_argument('--input', action="store", type=str, default=HardCodeVariable().SHANGHAITECH_PATH_PART_A)	parser.add_argument('--input', action="store", type=str, default=HardCodeVariable().SHANGHAITECH_PATH_PART_A)
87	88	parser.add_argument('--datasetname', action="store", default="shanghaitech_keepfull")	parser.add_argument('--datasetname', action="store", default="shanghaitech_keepfull")

File train_compact_cnn.py changed (mode: 100644) (index 1876089..dda90bb)
	1		from comet_ml import Experiment
	2
1	3	from args_util import my_args_parse	from args_util import my_args_parse
2	4	from data_flow import get_train_val_list, get_dataloader, create_training_image_list, create_image_list	from data_flow import get_train_val_list, get_dataloader, create_training_image_list, create_image_list
3	5	from ignite.engine import Events, create_supervised_trainer, create_supervised_evaluator	from ignite.engine import Events, create_supervised_trainer, create_supervised_evaluator

...	...	import torch
11	13	from torch import nn	from torch import nn
12	14	from models import CompactCNN	from models import CompactCNN
13	15	import os	import os
	16		from model_util import get_lr
14	17
	18		COMET_ML_API = "S3mM1eMq6NumMxk2QJAXASkUM"
	19		PROJECT_NAME = "crowd-counting-framework"
15	20
16	21	if __name__ == "__main__":	if __name__ == "__main__":
	22		experiment = Experiment(project_name=PROJECT_NAME, api_key=COMET_ML_API)
17	23	device = torch.device("cuda" if torch.cuda.is_available() else "cpu")	device = torch.device("cuda" if torch.cuda.is_available() else "cpu")
18	24	print(device)	print(device)
19	25	args = my_args_parse()	args = my_args_parse()
20	26	print(args)	print(args)
	27
	28		experiment.set_name(args.task_id)
	29		experiment.set_cmd_args()
	30
21	31	DATA_PATH = args.input	DATA_PATH = args.input
22	32	TRAIN_PATH = os.path.join(DATA_PATH, "train_data")	TRAIN_PATH = os.path.join(DATA_PATH, "train_data")
23	33	TEST_PATH = os.path.join(DATA_PATH, "test_data")	TEST_PATH = os.path.join(DATA_PATH, "test_data")

...	...	if __name__ == "__main__":
87	97	timestamp = get_readable_time()	timestamp = get_readable_time()
88	98	print(timestamp + " Training set Results - Epoch: {} Avg mae: {:.2f} Avg mse: {:.2f} Avg loss: {:.2f}"	print(timestamp + " Training set Results - Epoch: {} Avg mae: {:.2f} Avg mse: {:.2f} Avg loss: {:.2f}"
89	99	.format(trainer.state.epoch, metrics['mae'], metrics['mse'], metrics['nll']))	.format(trainer.state.epoch, metrics['mae'], metrics['mse'], metrics['nll']))
90
	100		experiment.log_metric("epoch", trainer.state.epoch)
	101		experiment.log_metric("train_mae", metrics['mae'])
	102		experiment.log_metric("train_mse", metrics['mse'])
	103		experiment.log_metric("train_loss", metrics['loss'])
	104		experiment.log_metric("lr", get_lr(optimizer))
91	105
92	106	@trainer.on(Events.EPOCH_COMPLETED)	@trainer.on(Events.EPOCH_COMPLETED)
93	107	def log_validation_results(trainer):	def log_validation_results(trainer):

...	...	if __name__ == "__main__":
96	110	timestamp = get_readable_time()	timestamp = get_readable_time()
97	111	print(timestamp + " Validation set Results - Epoch: {} Avg mae: {:.2f} Avg mse: {:.2f} Avg loss: {:.2f}"	print(timestamp + " Validation set Results - Epoch: {} Avg mae: {:.2f} Avg mse: {:.2f} Avg loss: {:.2f}"
98	112	.format(trainer.state.epoch, metrics['mae'], metrics['mse'], metrics['nll']))	.format(trainer.state.epoch, metrics['mae'], metrics['mse'], metrics['nll']))
99
	113		experiment.log_metric("valid_mae", metrics['mae'])
	114		experiment.log_metric("valid_mse", metrics['mse'])
	115		experiment.log_metric("valid_loss", metrics['loss'])
100	116
101	117
102	118	# docs on save and load	# docs on save and load

File train_script/CCNN/ccnn_v4_t1.sh added (mode: 100644) (index 0000000..2f6e700)
	1	CUDA_VISIBLE_DEVICES=6 HTTPS_PROXY="http://10.30.58.36:81" nohup python train_compact_cnn.py \
	2	--task_id ccnn_v4_t1 \
	3	--note "train ccnn with fixed lr 1e-5 no decay on keepfull and crop dataset part_A" \
	4	--input /data/rnd/thient/thient_data/ShanghaiTech/part_A \
	5	--lr 1e-5 \
	6	--decay 0 \
	7	--datasetname shanghaitech_keepfull_and_crop \
	8	--epochs 502 > logs/ccnn_v4_t1.log &

Hints:
Before first commit, do not forget to setup your git environment:

git config --global user.name "your_name_here"
git config --global user.email "your@email_here"

Clone this repository using HTTP(S):

git clone https://rocketgit.com/user/hahattpro/crowd_counting_framework

Clone this repository using ssh (do not forget to upload a key first):

git clone ssh://rocketgit@ssh.rocketgit.com/user/hahattpro/crowd_counting_framework

Clone this repository using git:

git clone git://git.rocketgit.com/user/hahattpro/crowd_counting_framework

You are allowed to anonymously push to this repository.
This means that your pushed commits will automatically be transformed into a merge request:

... clone the repository ...
... make some changes and some commits ...
git push origin main