Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

QDM 1.3.0 #24

Merged
merged 142 commits into from
Aug 27, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
142 commits
Select commit Hold shift + click to select a range
52ca091
Remove protocol_id from dict and tunnel class
mikeradka Apr 12, 2024
d760de6
Update desc with removal of protocol_id
mikeradka Apr 12, 2024
ee35ed9
Merge pull request #1039 from mikeradka/main
pagbabian-splunk Apr 15, 2024
c3adb85
feat: add file_result to File Hosting Activity
shellcromancer Apr 17, 2024
137d3cd
Fix grammar in status_details desc/caption
mikeradka Apr 18, 2024
150db6d
adding unknown enum value to query_result_id
floydtree Apr 18, 2024
ed3eb6a
Merge pull request #1050 from floydtree/enum_fix
Aniak5 Apr 18, 2024
9567e4c
Merge pull request #1049 from mikeradka/fix_grammar_in_dict
Aniak5 Apr 18, 2024
357b652
[nonbreaking] Minor indentation fix
mikeradka Apr 18, 2024
beaa9bc
Merge pull request #1052 from mikeradka/fix_indentation
pagbabian-splunk Apr 19, 2024
eaa9512
attempt colorized output
alanisaac Apr 18, 2024
55c8d50
try 2
alanisaac Apr 18, 2024
e17e743
try 3
alanisaac Apr 18, 2024
df05ea1
try 4
alanisaac Apr 18, 2024
7070e7f
changelog
alanisaac Apr 18, 2024
b06a773
clarify how to reference profiles
alanisaac Apr 19, 2024
7f8a174
changelog
alanisaac Apr 19, 2024
987839d
Merge branch 'main' into improve-profiles-description
alanisaac Apr 19, 2024
d11a59e
Merge pull request #1056 from alanisaac/improve-profiles-description
pagbabian-splunk Apr 19, 2024
6bb4f64
bugfix: logon_type_id enum correction
floydtree Apr 22, 2024
841f659
bugfix: adding type_name, deprecating type attribute in related_event…
floydtree Apr 22, 2024
b975332
Porting over 1.2.0 changelog to main, moving new items to unreleased …
floydtree Apr 22, 2024
e542cd0
Merge pull request #1058 from floydtree/bugfixes
zschmerber Apr 23, 2024
7b31e89
1057 Update linux_users caption
mikeradka Apr 22, 2024
acc023e
Address gaps in Process Activity and Memory Activity wrt process inje…
davemcatcisco Apr 23, 2024
597d7fa
Update CHANGELOG.md per submission guidelines.
davemcatcisco Apr 23, 2024
6f60bd0
Fixed CHANGELOG.md update following feedback.
davemcatcisco Apr 23, 2024
772beb2
feat: adds ext attribute to File object
shellcromancer Apr 17, 2024
795e08b
1
Apr 24, 2024
e093f0c
Merge pull request #1060 from davemcatcisco/main
mikeradka Apr 24, 2024
0b9da37
Add update, restart, enable, disable and add captions
mikeradka Apr 24, 2024
da6346c
Update CHANGELOG
mikeradka Apr 24, 2024
c4c772e
Merge pull request #1046 from shellcromancer/file_extension
mikeradka Apr 25, 2024
86b5feb
Merge pull request #1064 from mikeradka/update_application_activities
zschmerber Apr 25, 2024
b9506f9
Add an `Event Log Activity` Class (#1014)
mikeradka Apr 29, 2024
f7c7959
Added support for MITRE D3FEND, Remediation category and classes.
pagbabian-splunk Apr 30, 2024
48e4ea5
Added support for MITRE D3FEND, Remediation category and classes.
pagbabian-splunk Apr 30, 2024
2c3d278
Updated for PR #1066 (Remediation)
pagbabian-splunk Apr 30, 2024
a161086
Changed group for remediation and scan to Context from Primary.
pagbabian-splunk Apr 30, 2024
7d510f4
Remove .DS_Store from current directory
pagbabian-splunk Apr 30, 2024
84fceee
Removed .DS_Store
pagbabian-splunk Apr 30, 2024
933fae1
1
May 1, 2024
15002fd
1
May 1, 2024
4c8b7b0
1
May 1, 2024
56eb7ec
Merge branch 'main' into main
a-fishman May 1, 2024
9027a21
Feat: [#1069] - added signate state id into the Digital signature to …
PavelJurka May 2, 2024
21c74d5
cleaning up requirement definition in event classes
floydtree May 2, 2024
9317e95
cleaning up requirement definition in objects
floydtree May 2, 2024
f6aff84
cleaning up requirement definition in extensions
floydtree May 2, 2024
9c42657
adding a basic gitignore file
floydtree May 2, 2024
46e9587
adding a changelog entry for #1071
floydtree May 2, 2024
706575e
sorting dictionary alphanumerically
floydtree May 2, 2024
e7d0978
removing stale and unused files
floydtree May 2, 2024
8094ad5
cleaning up PR template
floydtree May 2, 2024
17a9904
Refactored d3fend to not use the attack objects but created new d3f_t…
pagbabian-splunk May 3, 2024
7aa86ea
Updated with additional MITRE objects; misc description and caption u…
pagbabian-splunk May 3, 2024
bd3c559
Registering a schema extension UID for Cisco
sunilamin May 3, 2024
3935ff4
Merge pull request #1071 from floydtree/schema-cleanup
pagbabian-splunk May 3, 2024
3cd43a8
Merge branch 'main' into cisco-extension-id
sunilamin May 3, 2024
e681d36
Merge pull request #1074 from sunilamin/cisco-extension-id
mikeradka May 3, 2024
6ffb29c
Merge branch 'main' into d3fend
pagbabian-splunk May 3, 2024
c37b10a
feat: [#1069] - digital signarure - simplified - PR
PavelJurka May 6, 2024
d1f446a
feat: [#1069] - digital signarure - simplified - PR
PavelJurka May 6, 2024
8a17495
feat: [#1069] - digital signarure - simplified - PR - state/state_id
PavelJurka May 8, 2024
3872edd
feat: [#1069] - digital signarure - simplified - PR - state/state_id
PavelJurka May 8, 2024
32c164d
Merge pull request #1062 from a-fishman/main
mikeradka May 8, 2024
6674d6b
Merge branch 'main' into signature_state
PavelJurka May 9, 2024
2574015
Feat: [#1069] - extended signature state with Suspended and Pending
PavelJurka May 13, 2024
0949e27
Merge pull request #1066 from ocsf/d3fend
mikeradka May 15, 2024
58d418f
Merge pull request #1070 from PavelJurka/signature_state
pagbabian-splunk May 15, 2024
d4d0a85
Fixed patch_state profile construction; Removed requirement overrides…
pagbabian-splunk May 15, 2024
171a9e8
Updated to include the PR #
pagbabian-splunk May 15, 2024
4541071
Add ja4+ component object
Aniak5 May 10, 2024
5d24910
Add ja4+ fingerprint object
Aniak5 May 10, 2024
3b45ccd
Add ja4+ fingerprint list, ja4+ component list and make component gen…
Aniak5 May 10, 2024
207a5dc
Make component specific w/in filesystem event class
Aniak5 May 10, 2024
a0dc36d
Add ja4+ fingerprint list object to base network class
Aniak5 May 10, 2024
8fd3907
Add ja4+ additions to changelog
Aniak5 May 10, 2024
73fa09b
Remove unused dictionary attribute
Aniak5 May 10, 2024
5211605
Change group to context instead of primary
Aniak5 May 10, 2024
6c00052
Add 'section_a/b/c/d' attributes to dictionary and to ja4 fingerprint…
Aniak5 May 16, 2024
fea283d
Merge pull request #1082 from Aniak5/issue-834
pagbabian-splunk May 17, 2024
3e8dc0f
External ticket support of ticketing systems like salesforce. (#1067)
PavelJurka May 17, 2024
da6b0a5
Added type_id and associated objects and constraints on the attributes.
pagbabian-splunk May 23, 2024
3180af9
Add domain attribute
mikeradka May 23, 2024
fbe17bd
Update CHANGELOG
mikeradka May 23, 2024
b717f6f
Added the email attribute and item to the type_id.
pagbabian-splunk May 23, 2024
f39cb45
Merge pull request #1096 from mikeradka/add_domain_attribute_to_url
mikeradka May 23, 2024
34ba2f2
Merge pull request #1087 from ocsf/patch_state
zschmerber May 28, 2024
9207c76
Added reg_key and reg_value attributes to Evidence Artifacts object.
davemcatcisco May 7, 2024
c12527d
Updated CHANGELOG.md per submission guidelines.
davemcatcisco May 7, 2024
7b7e0a4
Updated Changelog with Managed Entity improvements.
pagbabian-splunk May 29, 2024
a888270
Merge branch 'main' of https://github.com/ocsf/ocsf-schema into manag…
pagbabian-splunk May 29, 2024
ddb3604
Reordered CHANGELOG numbering to resolve conflict.
pagbabian-splunk May 29, 2024
6ee8cbe
Add activities
mikeradka May 23, 2024
75a2bad
Add activity descriptions
mikeradka May 23, 2024
38c698c
Update changelog
mikeradka May 23, 2024
eb099c6
Add Move activity
mikeradka May 23, 2024
4be307d
Add enable/disable and update descs
mikeradka May 23, 2024
4c57e27
Add unenroll for symmetry
mikeradka May 23, 2024
50e88f9
Update activity descriptions
mikeradka May 28, 2024
81883d5
Add clarity in activity desc
mikeradka May 28, 2024
07d57b2
update casing
mikeradka May 28, 2024
5c799b3
Update caption and desc
mikeradka May 29, 2024
2dd900b
Update changelog
mikeradka May 29, 2024
00764a7
Merge pull request #1094 from ocsf/managed_entity
mikeradka May 30, 2024
ef6e592
Fix typo in actor desc
mikeradka May 30, 2024
ad4cf3b
Merge pull request #1099 from mikeradka/main
Aniak5 May 30, 2024
277d210
Corrected the bad link in the d3fend object description (duplicate ht…
pagbabian-splunk May 30, 2024
7a8970d
Increasing ocsf-validator dependency to 0.2.x
query-jeremy May 30, 2024
5d1152c
Merge pull request #1101 from ocsf/validator-upgrade
mikeradka May 30, 2024
4a5420b
Create `osint` Profile (#992)
jonrau-at-queryai May 31, 2024
c0a18f2
Feat: [#1091] - extension of package by vendor_name and type (#1093)
PavelJurka Jun 4, 2024
bb1faf7
Improvements to Operating System Patch State 5004 (#1088)
jasonbreimer Jun 19, 2024
fbe28bb
Added 'Windows Service Activity' event. (#1103)
davemcatcisco Jun 21, 2024
9ded334
change the duration attribute to long_t (#1117)
jasonbreimer Jun 28, 2024
271f94b
Feat: [#1109] - extended compliance finding - compliance by adding co…
PavelJurka Jul 2, 2024
3759e0d
Improve and fix enum declarations (#1111)
mlmitch Jul 2, 2024
8e00d68
New Discovery software inventory class (#1134)
jasonbreimer Jul 3, 2024
f83ba83
Add router, ids, and ips entries to type_id enum in the Endpoint obje…
zl551q Jul 9, 2024
df2e130
Linting controls (#1063)
dkolbly Jul 9, 2024
079ef53
Adding credential_uid as an observable type, misc Changelog fixes (#1…
floydtree Jul 10, 2024
969e9f0
Update extensions.md to include US Gov (#1140)
k2niner Jul 12, 2024
144c790
Added job attribute to Evidence Artifacts object. (#1130)
davemcatcisco Jul 18, 2024
d7d5665
Fixing event class names, file names for the new remediation events (…
floydtree Jul 23, 2024
f0ea6bf
Adjust Entity Management class (3004) to be aligned with Windows even…
eliraz-levi Jul 23, 2024
e6d31b2
Added new activity `Listen` to `Network Activity` and relax requireme…
mlmitch Jul 23, 2024
819c74c
Enums with only the nominal values (0/99 or 99) in dictionary have 'S…
mlmitch Jul 25, 2024
0a1c03c
Software package object improvements (#1142)
jasonbreimer Jul 25, 2024
c6f4371
New Timespan object to encapsulate average durations. (#1125)
pagbabian-splunk Jul 26, 2024
e651e9d
Enhancement to load_balancer object (#1138)
pagbabian-splunk Jul 26, 2024
85a36b7
Feat: [1148] - enrichment extension (#1149)
PavelJurka Jul 30, 2024
b5c94d3
Fixing inconsistencies in the findings classes, other desc correction…
floydtree Jul 30, 2024
856af7c
adding state_id IDs (#1143)
SashaSelin Jul 30, 2024
c8bde8c
v1.3.0 Release (#1152)
floydtree Aug 1, 2024
133b84e
Merge remote-tracking branch 'upstream/v1.3.0' into qdm_1.3.0
query-jeremy Aug 22, 2024
ea3bb50
Create `OSINT Inventory Info` Discovery Event (#1154)
jonrau-at-queryai Aug 13, 2024
594e29c
`user` Object expansion and related Observables creation (#1155)
jonrau-at-queryai Aug 13, 2024
8fe4640
Expand applicability and direction of `cloud.account` and `cloud.org`…
jonrau-at-queryai Aug 21, 2024
42cf4e8
version bump
query-jeremy Aug 22, 2024
499951f
Removing old and conflicting reg key and value objects
query-jeremy Aug 22, 2024
de6d2a7
Running curator
query-jeremy Aug 23, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
43 changes: 0 additions & 43 deletions .github/labeler.yml

This file was deleted.

3 changes: 1 addition & 2 deletions .github/pull_request_template.md
Original file line number Diff line number Diff line change
Expand Up @@ -6,5 +6,4 @@
1. Did you add a single line summary of changes to `Unreleased` section in the [CHANGELOG.md](https://github.com/ocsf/ocsf-schema/blob/main/CHANGELOG.md) file?
2. Have you followed the [contribution guidelines](https://github.com/ocsf/ocsf-schema/blob/main/CONTRIBUTING.md)?
3. Did you run a local instance of the [ocsf-server](https://github.com/ocsf/ocsf-server) and ensure it ran without any errors/warnings?
4. Have you assigned appropriate labels to the PR?
5. Is your PR title in sync with the description?
4. Is your PR title in sync with the description?
5 changes: 3 additions & 2 deletions .github/workflows/deep-validate.yml
Original file line number Diff line number Diff line change
Expand Up @@ -20,7 +20,8 @@ jobs:
python-version: '3.11'

- name: Install validator
run: python -m pip install 'ocsf-validator>=0.1.1,<0.2'
run: python -m pip install 'ocsf-validator>=0.2,<0.3'

- name: Run validator
run: python -m ocsf_validator .
shell: bash
run: export FORCE_COLOR=1 && python -m ocsf_validator .
1 change: 1 addition & 0 deletions .gitignore
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
.DS_Store
109 changes: 98 additions & 11 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
Expand Up @@ -11,7 +11,7 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0

Thankyou! -->

## [Unreleased]
<!-- All available sections in the Changelog:

<!-- All available sections in the Changelog:

Expand All @@ -38,21 +38,105 @@ Thankyou! -->
### Misc

-->

## [Unreleased]

### Added
* #### Event Classes
1. Added `OSINT Inventory Info` event class to the Discovery category. #1154

### Improved
* #### Objects
1. Added `phone_number` to `user` and `ldap_person` objects. #1155
2. Added `has_mfa` to `user` object. #1155

### Misc
1. Added `user.uid` as an Observable type - `type_id: 31`. #1155
2. Added `group.name` and `group.uid` as Observable types - `type_id: 32` and `type_id: 33`, respectively. #1155
3. Added `account.name` and `account.uid` as Observable types - `type_id: 34` and `type_id: 35`, respectively. #1155
4. Added `has_mfa` boolean_t to Dictionary. #1155
5. Deprecate `project_uid`. #1166
6. Added several new enums to `account.type_id`. #1166

## [v1.3.0] - August 1st, 2024

### Added
* #### Categories
1. Added `Remediation` category. #1066
* #### Event Classes
1. Added `Data Security Finding` event class. - [#953](https://github.com/ocsf/ocsf-schema/pull/953)
1. Added `Event Log Activity` event class to the System Activity category. #1014
2. Added `Remediation Activity`, `File Remediation Activity`, `Process Remediation Activity`, `Network Remediation Activity` event classes to the Remediation category. #1066
3. Added `Windows Service Activity` event class to the System Activity category via Windows extension. #1103
4. Added `Software Inventory Info` event class to the Discovery category. #1134
* #### Profiles
1. Added `osint` Profile based on the `osint` object. #992
* #### Objects
1. Added new `data_security` object. - [#953](https://github.com/ocsf/ocsf-schema/pull/953)
1. Added `d3fend`, `d3f_tactic`, `d3f_technique` MITRE objects. #1066
2. Added `ja4_fingerprint` object. #834
3. Added `ja4_fingerprint_list` as a list of `ja4_fingerprint` objects. #834
4. Added `ticket` object. #1068
5. Added `osint` object. #992
6. Added `signatures` object, an array of `signature` objects. #992
7. Added `whois` object. #992
8. Added `domain_contact` and array-typed `domain_contacts` object for use with `whois` object. #992
9. Added `Windows Service` object to the Windows extension. #1103
10. Added `timespan` object. #1125

### Improved
* #### Categories
n/a
* #### Event Classes
1. Added `file_result` to File Hosting Activity. #1045
2. Added entries to `injection_type_id` enum (`Process Activity`) and `activity_id` enum (`Memory Activity`). #1060
3. Added a `Restart`, `Enable`, `Disable`, and `Update` `activity_id` to the `Application Lifecycle` class. #1064
4. Added `ja4_fingerprint_list` to base network event class. #834
5. Added `ticket` to `Incident Finding` event class. #1068
6. Added new activities `Enroll`, `Activate`, `Deactivate`, `Suspend`, and `Resume` to the `Entity Management` class. #1095
7. Added new activity `Listen` to `Network Activity` and relax requirement of `src_endpoint`. #1147
8. Added `state`, `state_id` to `Device Config State Change`. #1143
9. Added `resources` attribute to `Vulnerability Finding` and `Compliance Finding`. #1150
* #### Profiles
n/a
* #### Objects
1. Added two new enums to `confidentiality` object: `5 - Private` and `6 - Restricted` - [#953](https://github.com/ocsf/ocsf-schema/pull/953)
2. Expand `analytic.type_id` enum with descriptions and added several new enums to broaden the types of rules and use cases `analytic` can be used for - [#953](https://github.com/ocsf/ocsf-schema/pull/953)
- `Fingerprinting`
- `Tagging`
- `Exact Data Match`
- `Partial Data Match`
- `Indexed Data Match`
1. Added `ext` to `File` object. #1046
2. Added `account`, `device`, `email`, `url`, `user` to `evidences` in detection finding. #1000
3. Added `state_id`, `state` to `Digital Signature` object. #1069
4. Added `domain` to `Uniform Resource Locator` object. #1096
5. Added `reg_key` and `reg_value` to `Evidence Artifacts` object. #1078
6. Added `type_id` and associated entity objects to `Managed Entity`. #1094
7. Added `vendor_name`, `type`, `type_id` to object `package`. #1093
8. Added `router`, `ids`, and `ips` entries to `type_id` enum in the `Endpoint` object. #1121
9. Added `job` to `Evidence Artifacts` object. #1130
10. Added `ip` to object `load_balancer`. #1138
11. Added `cpe_name` and `hash` to `Software Package` object. #1142
12. Added `avg_timespan` to the `kb_article` object. #1125
13. Added `created_time`,`desc`, `short_desc`, `reputation`, `src_url` to `enrichment` object. #1149
14. Added `compliance_references`, `compliance_standards` to the `compliance` object. #1110

### Bugfixes
1. Fixed the host profile construction in `patch_state` event class. #1087
2. Removed the optional requirement overrides for `name` and `uid` in `_resource` as they are part of a constraint. #1087
3. Fixed declarations of `data_lifecycle_state_id`, `integrity`, `opcode_id`, `risk_level`, and `analytic.type_id`. #1111

### Deprecated
1. Deprecated `resource` in `Vulnerability Finding` and `Compliance Finding` event classes in favor of `resources`. #1150

### Breaking changes
n/a
### Misc
1. Colorized validator output #1048
* Updated the GitHub workflow for the `ocsf-validator` to print colorized output.
2. Clarify how to reference profiles in metadata #1056
* Updated the description of `metadata.profiles` to clarify the correct way to reference a profile in that list.
3. Added a `gitignore` file. #1071
4. New Extension registration for Cisco #1074
5. Cleaned up MITRE trademarks and registrations for captions and descriptions.
6. Declared enums in dictionary.json have sane "0" (Unknown) and "99" (Other) declarations and descriptions where appropriate #1111
7. Adds support for `suppress_checks` controls in attributes to allow tools to automatically validate conventions #1063
* Updated several attributes that do not follow conventions to disable linting for them
8. Added `credential_uid` as an Observable type - `type_id: 19`. #1137
9. New Extension registration for US Gov #1140
10. Enum definitions are now refactored such that generic enum descriptions have "See specific usage" in the description #1146

## [v1.2.0] - April 23rd, 2024

Expand Down Expand Up @@ -108,6 +192,8 @@ Thankyou! -->
7. Added a `Preauth` `activity_id` to the `Authentication` class. #1018
8. Added the `Security Control` profile to the `Datastore Activity` class. #1030
9. Added `risk_details` to Detection Finding. #1032
10. Added `access_mask` to Entity Management class. #1090
11. Added `access_list` to Entity Management class. #1090

* #### Profiles
n/a
Expand Down Expand Up @@ -145,6 +231,7 @@ Thankyou! -->
2. Deprecated `invoked_by` attribute in the `Actor` object in favor of `app_name`. #979.

### Breaking changes
n/a

### Misc
1. New Extension registration for Sedara. #951
Expand All @@ -155,7 +242,7 @@ Thankyou! -->
* _**(New)**_ Dictionary attributes using `observable` property in attribute. This allows defining all occurrences of this attribute as an observable.
* _**(New)**_ Object-specific attributes using `observable` property class's attributes. This allows defining object attributes as observables _only_ within instances of this specific object.
* _**(New)**_ Event class-specific attributes using `observable` property class's attributes. This allows defining class attributes as observables _only_ within instances of this specific class.
* _**(New)**_ Event class-specific attribute _paths_ using top-level `observables` property. The `observables` property holds an object mapping from a dotted attribute path to an observable `type_id`. This allows defining an observable _only_ within instances of this specific class, and only for the attributes at these paths, even for attributes that are within nested objects and arrays. This can also be used for top-level class attributes, which can be more convenient that defining a class attribute observable for classes that extend another, but don't otherwise change an attribute definition.
* _**(New)**_ Event class-specific attribute _paths_ using top-level `observables` property. The `observables` property holds an object mapping from an dotted attribute path to an observable `type_id`. This allows defining an observables _only_ within instances of this specific class, and only for the attributes at these paths, even for attributes that are within nested objects and arrays. This can also be used for top-level class attributes, which can be more convenient that defining a class attribute observable for classes that extend another, but don't otherwise change a attribute definition.
4. Metaschema improvements. #993
* Detect unexpected top-level properties in object and event class definitions. This was added at this point to detect invalid observable definitions: invalid `observable` property in event classes, and invalid `observables` property in objects.
* Remove hard-coded list of categories from `metaschema/categories.schema.json`, leaving this to the `ocsf-validator`. This change makes testing with alternate schemas that may add extra categories easier, as well as making it possible to validate private extensions that contain new categories.
Expand Down
5 changes: 5 additions & 0 deletions categories.json
Original file line number Diff line number Diff line change
Expand Up @@ -32,6 +32,11 @@
"caption": "Application Activity",
"description": "Application Activity events report detailed information about the behavior of applications and services.",
"uid": 6
},
"remediation": {
"caption": "Remediation",
"description": "Remediation events report the results of remediation commands targeting files, processes, and other objects.",
"uid": 7
}
}
}
Loading
Loading