- | 參數類別 |
- 參數名稱 |
- 分佈範圍 |
+ Category |
+ Parameter |
+ Description |
+ Distribution |
- | 3D物體 | 構成背景的3D模型集合 | 一組幾何形狀的3D模型(10種) |
- | 產生背景物體位置的泊松圓盤採樣半徑 | 常數(0.2) |
- | 背景物體尺寸的縮放比例 | 常數(2.5) |
- | 遮擋物的3D模型集合 | 一組幾何形狀的3D模型 |
- | 遮擋物分布於虛擬場景中的範圍 | 笛卡兒坐標[均勻分布(-0.6, 0.6), 均勻分布(-0.4, 0.4), 均勻分布(1.5, 1.9)] |
- | 產生遮擋物位置的泊松圓盤採樣半徑 | 常數(0.25) |
- | 遮擋物出現於虛擬場景內的數量 | 均勻分布(5, 10) |
- | 遮擋物物體尺寸的縮放比例 | 均勻分布(0.5, 1.5) |
- | 零售商品分布於虛擬場景中的範圍 | 笛卡兒坐標[均勻分布(-1.25, 1.25), 均勻分布(-0.75, 0.75), 均勻分布(0.5, 1)] |
- | 產產生前景物體位置的泊松圓盤採樣半徑 | 常數(0.3) |
- | 前景物體出現於虛擬場景內的數量 | 均勻分布(8, 20) |
- | 前景物體尺寸的縮放比例 | 均勻分布(0.5, 2.5) |
- | 干擾物與背景物體之姿態旋轉角度 | 歐拉角[均勻分布(0, 360), 均勻分布(0, 360), 均勻分布(0, 360)] |
- | 零售商品之統一姿態旋轉角度 | 歐拉角[均勻分布(0, 360), 均勻分布(0, 360), 均勻分布(0, 360)] |
- | 紋理材質 | 遮蔽/干擾物與背景物體之紋理材質 | 一組PBR材質(1369種) |
- | 環境照明 | HDRI環境照明 | 一組HDRI照明貼圖(561種) |
- | 照明強度 | 均勻分佈(0.2, 2.2) |
- | 照明旋轉角度 | 歐拉角[均勻分布(-30, 120), 均勻分布(-30, 30), 均勻分布(0, 360)] |
- | 相機與後處理 | 虛擬相機鏡頭焦距 | 常數(35) |
- | 影像解析度 | 零售商品辨識:1728*1152 |
- | 鏡頭色差效果 | 均勻分布(0.1, 1) |
- | 模糊效果 | 均勻分布(2, 4) |
- | 運動模糊效果 | 均勻分布(2, 7) |
- | 曝光效果 | 均勻分布(-0.5, 2) |
- | 椒鹽雜訊效果 | 均勻分布(1.6, 1.8) |
- | 影像白平衡調整 | 均勻分布(3500, 9500) |
- | 影像亮度調整 | 均勻分布(-1, 1) |
- | 影像對比度調整 | 均勻分布(-1, 3) |
- | 影像飽和度調整 | 均勻分布(0.75, 1.25) |
- | 影像色相調整 | 均勻分布(0.45, 0.55) |
-
+ | Dataset size | gen_num | The quantity of synthetic images needed to be generated. | Constant(10) |
+ | 3D Object | asset_background_object_folder_path | A set of 3D models containing various simple geometric shapes such as cubes and cylinders. | A set of 3d model assets(10) |
+ background_poisson_disk_sampling_radius | Background objects separation distance. | Constant(0.2) |
+ bg_obj_scale_ratio_range | The distribution of the scale ratio of background objects within the blender scene. | Constant(2.5) |
+ asset_occluder_folder_path | A set of 3D models containing various simple geometric shapes such as cubes and cylinders. | A set of 3d model assets(10) |
+ occluder_area | Spatial distribution area of occlusion objects. | Cartesian[Uniform(-0.6, 0.6), Uniform(-0.4, 0.4), Uniform(1.5, 1.9)] |
+ occluder_poisson_disk_sampling_radius | Occlusion objects separation distance. | Constant(0.25) |
+ num_occluder_in_scene_range | The distribution of the number of occlusion objects within the blender scene. | Uniform(5, 10) |
+ occluder_scale_ratio_range | The distribution of the scale ratio of occluder objects within the blender scene. | Uniform(0.5, 2) |
+ asset_foreground_object_folder_path | A set of 63 retail items 3D assets. | A set of 3d model assets(63) |
+ foreground_area | Spatial distribution area of foreground objects. | Cartesian[Uniform(-1.25, 1.25), Uniform(-0.75, 0.75), Uniform(0.5, 1)] |
+ foreground_poisson_disk_sampling_radius | Foreground objects separation distance. | Constant(0.3) |
+ num_foreground_object_in_scene_range | The distribution of the number of retail items within the blender scene. | Uniform(8, 20) |
+ fg_obj_scale_ratio_range | The distribution of the scale ratio of foreground objects within the blender scene. | Uniform(0.5, 2.2) |
+ - | Random rotation angle to background and occluder objects. | Euler[Uniform(0, 360), Uniform(0, 360), Uniform(0, 360)] |
+ - | Random unified rotation angle to all foreground (retail products) objects. | Euler[Uniform(0, 360), Uniform(0, 360), Uniform(0, 360)] |
+ | Texture | asset_ambientCGMaterial_folder_path | A set of PBR materials that are randomly applied to the surfaces of the background and occluder objects | A set of PBR texture assets(10) |
+ | Environment Lighting | asset_hdri_lighting_folder_path | A set of high dynamic range images (HDRI) for scene lighting. | A set of hdri assets(10) |
+ | hdri_lighting_strength_range | The distribution of the strength factor for the intensity of the HDRI scene light. | Uniform(0.1, 2.2) |
+ | - | Randomly rotate HDRI map. | Euler[Uniform(-30, 120), Uniform(-30, 30), Uniform(0, 360)] |
+ | Camera & Post-processing | - | Perspective Camera focal length value in millimeters. | Constant(35) |
+ | img_resolution_x | Number of horizontal pixels in the rendered image. | Constant(1728) |
+ | img_resolution_y | Number of vertical pixels in the rendered image. | Constant(1152) |
+ | max_samples | Number of samples to render for each pixel. | Constant(128) |
+ | chromatic_aberration_value_range | The distribution of the value of Lens Distortion nodes input-Dispersion, which simulates chromatic aberration. | Uniform(0.1, 1) |
+ | blur_value_range | The distribution of the value of Blur nodes input-Size, which controls the blur radius values. | Uniform(2, 4) |
+ | motion_blur_value_range | The distribution of the value of Vector Blur nodes input-Speed, which controls the direction of motion. | Uniform(2, 7) |
+ | exposure_value_range | The distribution of the value of Exposure nodes input-Exposure, which controls the scalar factor to adjust the exposure. | Uniform(-0.5, 2) |
+ | noise_value_range | The distribution of the value of brightness of the noise texture. | Uniform(1.6, 1.8) |
+ | white_balance_value_range | The distribution of the value of WhiteBalanceNode input-ColorTemperature, which adjust the color temperature. | Uniform(3500, 9500) |
+ | brightness_value_range | The distribution of the value of Bright/Contrast nodes input-Bright, which adjust the brightness. | Uniform(-1, 1) |
+ | contrast_value_range | The distribution of the value of Bright/Contrast nodes input-Contrast, which adjust the contrast. | Uniform(-1, 5) |
+ | hue_value_range | The distribution of the value of Hue Saturation Value nodes input-Hue, which adjust the hue. | Uniform(0.45, 0.55) |
+ | saturation_value_range | The distribution of the value of Hue Saturation Value nodes input-Saturation, which adjust the saturation. | Uniform(0.75, 1.25) |
+ | chromatic_aberration_probability | Probability of chromatic aberration effect being enabled. | P(enabled) = 0.1, P(disabled) = 0.9 |
+ | blur_probability | Probability of blur effect being enabled. | P(enabled) = 0.1, P(disabled) = 0.9 |
+ | motion_blur_probability | Probability of motion blur effect being enabled. | P(enabled) = 0.1, P(disabled) = 0.9 |
+ | exposure_probability | Probability of exposure adjustment being enabled. | P(enabled) = 0.15, P(disabled) = 0.85 |
+ | noise_probability | Probability of noise effect being enabled. | P(enabled) = 0.1, P(disabled) = 0.9 |
+ | white_balance_probability | Probability of white balance adjustment being enabled. | P(enabled) = 0.15, P(disabled) = 0.85 |
+ | brightness_probability | Probability of brightness adjustment being enabled. | P(enabled) = 0.15, P(disabled) = 0.85 |
+ | contrast_probability | Probability of contrast adjustment being enabled. | P(enabled) = 0.15, P(disabled) = 0.85 |
+ | hue_probability | Probability of hue adjustment being enabled. | P(enabled) = 0.15, P(disabled) = 0.85 |
+ | saturation_probability | Probability of saturation adjustment being enabled. | P(enabled) = 0.15, P(disabled) = 0.85 |
+#### 2.Initiate the synthetic data generation loop via `SDG_400_Looper.py`
+Once the parameter settings are configured, execute the `SDG_400_Looper.py` file to initiate the synthetic data generation loop.
+
+## Additional resource
+**Real Retail Product Image Dataset for validation purpose** : Consisting of 1267 images of real retail products, this dataset originated from the [UnityGroceries-Real Dataset](https://github.com/Unity-Technologies/SynthDet/blob/master/docs/UnityGroceriesReal.md). This project has corrected annotation errors and converted the data labels into YOLO format. The dataset can be downloaded from this [Google Drive link](https://drive.google.com/file/d/1RPFCBf4z7A4NkskV6Jn1MYwirZqf_qtR/view?usp=sharing)."
-## **4. YOLOv5模型訓練及結果**
+## Inspiration
-{% include data.html %}
+This project is inspired by the [Unity SynthDet](https://github.com/Unity-Technologies/SynthDet/tree/master) project, with improvements in methodology (including the addition of PBR materials, HDRI lighting, and ray tracing rendering), and it has been recreated using Blender.
+Borkman, Steve, et al. (2021). [*Unity perception: Generate synthetic data for computer vision.* ](https://arxiv.org/abs/2107.04259)
diff --git a/SDG/SDG_200_SDGParameter.py b/SDG/SDG_200_SDGParameter.py
index 832e771..ae8dd1e 100644
--- a/SDG/SDG_200_SDGParameter.py
+++ b/SDG/SDG_200_SDGParameter.py
@@ -54,13 +54,13 @@ class SDGParameter:
"""
def __init__(self):
- self.gen_num = 2
+ self.gen_num = 10
self.blender_exe_path = "C:/program Files/Blender Foundation/Blender 3.3/blender"
- self.asset_background_object_folder_path = "C:/Users/user/Documents/project/Synthetic-Data-Generator-for-Retail-Products-Detection/Assets/background_object"
+ self.asset_background_object_folder_path = "C:/Users/user/Documents/project/Synthetic-Data-Generator-for-Retail-Products-Detection/Assets/background_occluder_object"
self.asset_foreground_object_folder_path = "C:/Users/user/Documents/project/Synthetic-Data-Generator-for-Retail-Products-Detection/Assets/foreground_object"
- self.asset_ambientCGMaterial_folder_path = "C:/Users/user/Documents/project/Synthetic-Data-Generator-for-Retail-Products-Detection/Assets/texture"
- self.asset_hdri_lighting_folder_path = "C:/Users/user/Documents/project/Synthetic-Data-Generator-for-Retail-Products-Detection/Assets/HDRI"
- self.asset_occluder_folder_path = "C:/Users/user/Documents/project/Synthetic-Data-Generator-for-Retail-Products-Detection/Assets/occluder"
+ self.asset_ambientCGMaterial_folder_path = "C:/Users/user/Documents/project/Synthetic-Data-Generator-for-Retail-Products-Detection/Assets/pbr_texture"
+ self.asset_hdri_lighting_folder_path = "C:/Users/user/Documents/project/Synthetic-Data-Generator-for-Retail-Products-Detection/Assets/hdri_lighting"
+ self.asset_occluder_folder_path = "C:/Users/user/Documents/project/Synthetic-Data-Generator-for-Retail-Products-Detection/Assets/background_occluder_object"
self.output_img_path = "C:/Users/user/Documents/project/Synthetic-Data-Generator-for-Retail-Products-Detection/gen_data/images"
self.output_label_path = "C:/Users/user/Documents/project/Synthetic-Data-Generator-for-Retail-Products-Detection/gen_data/labels"
self.background_poisson_disk_sampling_radius = 0.2
@@ -76,7 +76,7 @@ def __init__(self):
self.hdri_lighting_strength_range = {"min": 0.2 , "max": 2.2}
self.img_resolution_x = 1728
self.img_resolution_y = 1152
- self.max_samples = 256
+ self.max_samples = 128
self.chromatic_aberration_probability = 0.1
self.blur_probability = 0.1
self.motion_blur_probability = 0.1
diff --git a/SDG/SDG_log.txt b/SDG/SDG_log.txt
new file mode 100644
index 0000000..70b54d5
--- /dev/null
+++ b/SDG/SDG_log.txt
@@ -0,0 +1,20 @@
+asset_background_object_folder_path:C:/Users/user/Documents/project/Synthetic-Data-Generator-for-Retail-Products-Detection/Assets/background_object
+asset_foreground_object_folder_path:C:/Users/user/Documents/project/Synthetic-Data-Generator-for-Retail-Products-Detection/Assets/foreground_object
+asset_occluder_folder_path:C:/Users/user/Documents/project/Synthetic-Data-Generator-for-Retail-Products-Detection/Assets/occluder
+asset_ambientCGMaterial_folder_path:C:/Users/user/Documents/project/Synthetic-Data-Generator-for-Retail-Products-Detection/Assets/texture
+asset_hdri_lighting_folder_path:C:/Users/user/Documents/project/Synthetic-Data-Generator-for-Retail-Products-Detection/Assets/HDRI
+output_img_path:C:/Users/user/Documents/project/Synthetic-Data-Generator-for-Retail-Products-Detection/gen_data/images
+output_label_path:C:/Users/user/Documents/project/Synthetic-Data-Generator-for-Retail-Products-Detection/gen_data/labels
+num_foreground_object_in_scene_range:{'min': 8, 'max': 20}
+num_occluder_in_scene_range:{'min': 5, 'max': 10}
+max_samples:256
+chromatic_aberration_probability:0.1
+blur_probability:0.1
+motion_blur_probability:0.1
+exposure_probability:0.15
+noise_probability:0.1
+white_balance_probability:0.15
+brightness_probability:0.15
+contrast_probability:0.15
+hue_probability:0.15
+saturation_probability:0.15
diff --git a/SDG_log.txt b/SDG_log.txt
index 70b54d5..3f308fd 100644
--- a/SDG_log.txt
+++ b/SDG_log.txt
@@ -1,13 +1,13 @@
-asset_background_object_folder_path:C:/Users/user/Documents/project/Synthetic-Data-Generator-for-Retail-Products-Detection/Assets/background_object
+asset_background_object_folder_path:C:/Users/user/Documents/project/Synthetic-Data-Generator-for-Retail-Products-Detection/Assets/background_occluder_object
asset_foreground_object_folder_path:C:/Users/user/Documents/project/Synthetic-Data-Generator-for-Retail-Products-Detection/Assets/foreground_object
-asset_occluder_folder_path:C:/Users/user/Documents/project/Synthetic-Data-Generator-for-Retail-Products-Detection/Assets/occluder
-asset_ambientCGMaterial_folder_path:C:/Users/user/Documents/project/Synthetic-Data-Generator-for-Retail-Products-Detection/Assets/texture
-asset_hdri_lighting_folder_path:C:/Users/user/Documents/project/Synthetic-Data-Generator-for-Retail-Products-Detection/Assets/HDRI
+asset_occluder_folder_path:C:/Users/user/Documents/project/Synthetic-Data-Generator-for-Retail-Products-Detection/Assets/background_occluder_object
+asset_ambientCGMaterial_folder_path:C:/Users/user/Documents/project/Synthetic-Data-Generator-for-Retail-Products-Detection/Assets/pbr_texture
+asset_hdri_lighting_folder_path:C:/Users/user/Documents/project/Synthetic-Data-Generator-for-Retail-Products-Detection/Assets/hdri_lighting
output_img_path:C:/Users/user/Documents/project/Synthetic-Data-Generator-for-Retail-Products-Detection/gen_data/images
output_label_path:C:/Users/user/Documents/project/Synthetic-Data-Generator-for-Retail-Products-Detection/gen_data/labels
num_foreground_object_in_scene_range:{'min': 8, 'max': 20}
num_occluder_in_scene_range:{'min': 5, 'max': 10}
-max_samples:256
+max_samples:128
chromatic_aberration_probability:0.1
blur_probability:0.1
motion_blur_probability:0.1
diff --git a/docs/images/gen_data.PNG b/docs/images/gen_data.PNG
new file mode 100644
index 0000000000000000000000000000000000000000..96b2f74f47b61571ada73cb8d5912f62c111a92c
GIT binary patch
literal 3892813
zcmd43c{r5s`!{~uvZrJ#SxTa;rI4MHWG%8Y6iLF!9y4Q?M7v31XraZvjIoZT$WF>O
z7`rs~WrkUwo8Is5^Zh)Z_vd+@-yhF${O;p$nA?5b*LBUgpRe=0BwCsq@p2vF0sw&5
z_|k=|0I>6sEskRk`0J}%iUatIDd4J+0Z`C&cpkiA_0%`h2Y}*7+*CI<@SYQT$vyx8
z_BQSOFtzx7a0dX!d*ciG)}by7G|%S(MsJqFQQ^d`gXd~UV`t4n_i-$XF4r1GuH2re
z&R!i$-xIa(lH@+~Z{Ej_9q~HWd@JwfMU_%g*Z^F2Bxs
-
-
-
-
-#### 前景物體生成
-虛擬場景的前景產生方式，是從 63 個零售商品的 3D 資產中隨機選取一個子集，並將這些 3D 資產隨機放置於背景物體上方的區域，前景物體的放置位置與彼此間的距離，由給定空間範圍的泊松分布採樣產生。
+When rendering images and generating data labels, image and label files will be generated in the`gen_data`folder.
+
-
-
-
-
-
-