pySCG: Numbers related landing page to explain generic issues, such as array with ctypes and numpy

Abierto
  • ¿Algo no está bien?
#13 0 comentarios 0 reacciones 0 asignados Ver en GitHub

Nadie ha tomado este issue todavía.

Evaluación

Dificultad
4/5
Tiempo estimado
3-5 días
Aptitud para principiantes
42/100
Tipo de issue
Documentación
Claridad
Bastante claro
Estado de actividad
Estancado
Stack tecnológico
numpy, python
Área
documentation, security

Línea de trabajo

Start by reviewing the repository’s existing CWE-191, CWE-1335, and CWE-197 pages and the linked material, then check how numeric issue pages are organized. Draft a shared landing page covering Python integers, array, numpy, ctypes, conversions, numeric bounds, and the bytes examples. Done when it explains these topics accurately and links to the related numeric issues.

Escrito por el modelo de indexación a partir del texto del issue.

Descripción

Numbers landing page to explain generic issues around:

  • Hardware limitations
  • A Python int can be much bigger than what is known as 64 bit int and why NUM13 does not apply
  • Python relation to primitive int numpy ctypes
  • implicit conversion can come unexpected
  • explicit conversion can have unexpected results.
  • Upper boundaries
  • Lower boundaries.

Content that is helpful for understanding numbers or above points and applicable for all numeric related issues such as
Avoid loss of precision when converting primitive integers to floating-point

Pythons array module is the closest thing to primitive types mentioned in the Java or C rules such as unsigned or signed int, float, long or char. The array module should be at least mentioned together with numpy and ctypes.

CWE-191: Detect or prevent integer overflow

"by classes and are protected against overflows.  Primitive types such as numpy , time  or ctype share issues known from C , or C++"

CWE-1335: Incorrect Bitwise Shift of Integer

CWE-1335: Promote readability and compatibility by using mathematical written code with arithmetic operations instead of bit-wise operations

"outcomes. Python's ctypes  module allows integration of C based system libraries into Python and direct access to C-type variables that can have"

CWE-197: Control rounding when converting to less precise numbers

"Python has ctypes module allowing users to work with many different data types. "

Additional notes from previous conversations:
A build in type byte does not exist in Python 3, try byte(0) vs bytes(0).

The bytes and bytearray classes are both designed for binary data as a sequence of integers capped to byte size range of decimal 0 to 255. The use of bytes for memory optimization is unlikely of help as it requires the extra handling and storage for the sequence part; compare sys.getsizeof(bytes(10)) vs sys.getsizeof(int(10)).

String presentations such as decimal 10 displayed by the programming IDE as a newline \n character can be confusing.

Storing anything bigger than an decimal 255 in bytes requires to spread the number across a sequence of byte sized objects.

Designing with bytes and bytearray classes requires a good understanding of example01.py code. Python objects can be stored directly via the pickle and unpickle modules. Memory optimization is better addressed by understanding the difference between mutable and nonmutable objects in Python.

example01.py:

# byte object does not exist:
byte(10)     {}# NameError: name 'byte' is not defined
 
# bytes(10) creates a sequence with 10 items
bytes(10)    {}# b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
 
# string representation can be confusing
bytes([{}}}\{{{}10{}}}\{{{}])  {}# b'\n' ;IDE printing hex 0a as newline \n
bytes([{}}}\{{{}10{}}}\{{{}]).hex()     {}# '0a'
b'10' == b'\x31\x30'  # True ; decimal string 10 to hex string \x31\x30
 
# storing byte sized decimal in bytes compared to build in int:
print(sys.getsizeof(bytes([{}}}\{{{}10{}}}\{{{}])))  {}# 34
print(sys.getsizeof(10))           {}{ {# 28 }
}
 
# different platform store number invers to each other:
int(1).to_bytes(2, {}'little')  {}# b'\x01\x00'
int(1).to_bytes(2, {}'big')     {}# b'\x00\x01'
 
# bytes comes with Overflow protection
int(256).to_bytes(1, {}'big')   {}# OverflowError: int too big to convert
Lenguaje dominante
Python
Estrellas
2
Forks
2
Merge medio
11 min
PR fusionados (30 d)
2

Preparar el entorno

Primeros pasos

  1. Lee el issue completo y luego la guía de contribución del proyecto.
  2. Comenta en el issue que vas a ocuparte — evita que dos personas hagan lo mismo.
  3. Haz un fork del repositorio y trabaja en una rama.
  4. Abre un pull request que haga referencia al número del issue.

Más de ossf/python-secure-coding-guide

Todos los issues de ossf/python-secure-coding-guide

Issues similares

Más issues de Python

Recibe los nuevos issues en tu correo

Un resumen breve de issues de GitHub para principiantes.