\( \newcommand{\matr}[1] {\mathbf{#1}} \newcommand{\vertbar} {\rule[-1ex]{0.5pt}{2.5ex}} \newcommand{\horzbar} {\rule[.5ex]{2.5ex}{0.5pt}} \newcommand{\E} {\mathrm{E}} \)
deepdream of a sidewalk
Show Answer
Math and science::INF ML AI

Sinusoidal positional embedding

  1. Can you remember how to generate an embedding for an array of shape [n_time, n_channel]?
  2. How to add this array to a Pytorch module?