-
Notifications
You must be signed in to change notification settings - Fork 23
add float16 encoding #22
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
@@ -362,7 +370,7 @@ message Format { | |||
UNKNOWN = 0; | |||
LINEAR16 = 1; | |||
} | |||
|
|||
// Any encoding specified in a Layer overides this. | |||
optional Encoding weights_encoding = 1; |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
We can actually remove this field (replace with reserved 1) — it will be just ignored parsed by code that doesn't know it.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I'm not sure this won't break older builds. But we can certainly do that after we move it to lc0.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
It likely would be fine, but let's keep for now.
@@ -362,7 +370,7 @@ message Format { | |||
UNKNOWN = 0; | |||
LINEAR16 = 1; | |||
} | |||
|
|||
// Any encoding specified in a Layer overides this. | |||
optional Encoding weights_encoding = 1; |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
It likely would be fine, but let's keep for now.
The encoding is moved to the Weights where it makes sense and can be used where the weights are passed around without needing to keep track of the encoding separately.Turns out it is more convenient to have the encoding in each
Layer
.Also adds a
dims
field perLayer
to store the tensor dimensions.