Search results

What is the purpose of positional offset in the rotary positional embedding implementation?

Status: Open.

#24 In lucidrains/recurrent-memory-transformer-pytorch;

· ifed-ucsd opened on Jul 1, 2024

Implement RMT-R (New Paper feature to RMTs)

Status: Open.

#23 In lucidrains/recurrent-memory-transformer-pytorch;

· anoojpatel opened on Mar 31, 2024

Question: first read memories

Status: Open.

#19 In lucidrains/recurrent-memory-transformer-pytorch;

· pfeatherstone opened on Aug 30, 2023

Feature request: make JIT and ONNX export work

Status: Open.

#16 In lucidrains/recurrent-memory-transformer-pytorch;

· pfeatherstone opened on Aug 29, 2023

Question: configuring scaled_dot_product_attention

Status: Open.

#11 In lucidrains/recurrent-memory-transformer-pytorch;

· pfeatherstone opened on Aug 8, 2023

Question: how to adapt this for CTC loss

Status: Open.

#9 In lucidrains/recurrent-memory-transformer-pytorch;

· pfeatherstone opened on Aug 8, 2023

Question: How to set seq_len ?

Status: Open.

#8 In lucidrains/recurrent-memory-transformer-pytorch;

· pfeatherstone opened on Aug 8, 2023

have you had a chance to train it yet?

Status: Open.

#5 In lucidrains/recurrent-memory-transformer-pytorch;

· Alignment-Lab-AI opened on May 3, 2023