Skip to content
GitLab
Explore
Sign in
Register
Primary navigation
Search or go to…
Project
T
Tensor-Core Correlator
Manage
Activity
Members
Labels
Plan
Issues
Issue boards
Milestones
Iterations
Wiki
Requirements
Jira
Code
Merge requests
Repository
Branches
Commits
Tags
Repository graph
Compare revisions
Snippets
Locked files
Build
Pipelines
Jobs
Pipeline schedules
Test cases
Artifacts
Deploy
Releases
Package registry
Container registry
Model registry
Operate
Environments
Terraform modules
Monitor
Incidents
Analyze
Value stream analytics
Contributor analytics
CI/CD analytics
Repository analytics
Code review analytics
Issue analytics
Insights
Model experiments
Help
Help
Support
GitLab documentation
Compare GitLab plans
GitLab community forum
Contribute to GitLab
Provide feedback
Keyboard shortcuts
?
Snippets
Groups
Projects
Show more breadcrumbs
ResearchAndDevelopment
Tensor-Core Correlator
Commits
e0cde58d
Commit
e0cde58d
authored
2 months ago
by
John Romein
Browse files
Options
Downloads
Patches
Plain Diff
Updated for e4m3/e5m2 support.
parent
2da65b31
No related branches found
No related tags found
1 merge request
!15
Fp8
Pipeline
#114275
failed
2 months ago
Stage: build
Stage: testing
Changes
1
Pipelines
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
README.md
+22
-9
22 additions, 9 deletions
README.md
with
22 additions
and
9 deletions
README.md
+
22
−
9
View file @
e0cde58d
...
@@ -32,36 +32,49 @@ how to use the CUDA driver API (wrappers); and
...
@@ -32,36 +32,49 @@ how to use the CUDA driver API (wrappers); and
OpenCL program.
`test/CorrelatorTest/CorrelatorTest.cc`
is a much more versatile,
OpenCL program.
`test/CorrelatorTest/CorrelatorTest.cc`
is a much more versatile,
robust (and complex) example than
`test/SimpleExample/SimpleExample.cu`
.
robust (and complex) example than
`test/SimpleExample/SimpleExample.cu`
.
Input and output data types are defined as follows:
The TCC accepts the following input data types:
-
half precision floating point (a.k.a. fp16), starting from Volta (sm
\_
70)
-
e4m3 and e5m2 (a.k.a. fp8), starting from Hopper (sm
\_
90)
-
8-bit integers (i8), starting from the Jetson Xavier (sm
\_
72)
-
4-bit integers (i4), only natively supported on Ampere and Ada
```
```
#if NR_BITS == 4
#if INPUT_FORMAT == FORMAT_I4
#define NR_TIMES_PER_BLOCK 32
typedef complex_int4_t Sample;
typedef complex_int4_t Sample;
typedef std::complex<int32_t> Visibility;
typedef std::complex<int32_t> Visibility;
#elif NR_BITS == 8
#elif INPUT_FORMAT == FORMAT_I8
#define NR_TIMES_PER_BLOCK 16
typedef std::complex<int8_t> Sample;
typedef std::complex<int8_t> Sample;
typedef std::complex<int32_t> Visibility;
typedef std::complex<int32_t> Visibility;
#elif NR_BITS == 16
#elif INPUT_FORMAT == FORMAT_E4M3
#define NR_TIMES_PER_BLOCK 16
typedef std::complex<__nv_fp8_e4m3> Sample;
typedef std::complex<float> Visibility;
#elif INPUT_FORMAT == FORMAT_E5M2
#define NR_TIMES_PER_BLOCK 16
typedef std::complex<__nv_fp8_e5m2> Sample;
typedef std::complex<float> Visibility;
#elif INPUT_FORMAT == FORMAT_FP16
#define NR_TIMES_PER_BLOCK 8
typedef std::complex<__half> Sample;
typedef std::complex<__half> Sample;
typedef std::complex<float> Visibility;
typedef std::complex<float> Visibility;
#endif
#endif
#define NR_TIMES_PER_BLOCK (128 / NR_BITS)
typedef Sample Samples[NR_CHANNELS][NR_SAMPLES_PER_CHANNEL / NR_TIMES_PER_BLOCK][NR_RECEIVERS][NR_POLARIZATIONS][NR_TIMES_PER_BLOCK];
typedef Sample Samples[NR_CHANNELS][NR_SAMPLES_PER_CHANNEL / NR_TIMES_PER_BLOCK][NR_RECEIVERS][NR_POLARIZATIONS][NR_TIMES_PER_BLOCK];
typedef Visibility Visibilities[NR_CHANNELS][NR_BASELINES][NR_POLARIZATIONS][NR_POLARIZATIONS];
typedef Visibility Visibilities[NR_CHANNELS][NR_BASELINES][NR_POLARIZATIONS][NR_POLARIZATIONS];
```
```
Note that
in 4-bit and 8-bit mode
, the input samples may not contain -8 or -128
Note that
with FORMAT
\_
I4 and FORMAT
\_
I8
, the input samples may not contain -8 or -128
respectively, as these values cannot be conjugated properly.
respectively, as these values cannot be conjugated properly.
The input data type (
`Samples`
) is a weird format, but this seemed to be the only
The input data type (
`Samples`
) is a weird format, but this seemed to be the only
format that yields good performance (tensor cores are very unforgiving).
format that yields good performance (tensor cores are very unforgiving).
Limitations:
Limitations:
-
`NR_POLARIZATIONS`
must be 2
-
`NR_POLARIZATIONS`
must be 2
-
`NR_BITS`
must be 4, 8, or 16
-
the amount of samples over which is integrated must be a multiple of
-
the amount of samples over which is integrated) must be a multiple of 128 /
`NR_BITS`
NR
\_
TIMES
\_
PER
\_
BLOCK.
(i.e., 32, 16, or 8 for 4-bit, 8-bit, or 16-bit input, respectively).
## Building, testing, and installation
## Building, testing, and installation
Clone the repository:
Clone the repository:
...
...
This diff is collapsed.
Click to expand it.
Preview
0%
Loading
Try again
or
attach a new file
.
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Save comment
Cancel
Please
register
or
sign in
to comment